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(54) CONTROL DEVICE 

(57)Abstraqt: 

PROBLEM TO BE SOLVED: To provide a control device 
capable of implementing the operation of equipment 
adapted to meet the demands of users. 
- ' SOLUTION: The control device to control various 

equipment on board of a vehicle while having interaction 
with a user by voice is provided with an interaction 
database formed of plural interaction data LI 4. L15... 
each appropriately describing contents on items of 
conditions (environments around the vehicle, conditions 
outside the vehicle, conditions inside the vehicle, etc.), in 
which the user is situated, user demands, the personal 
information of the user, the speech key word (user 
speech) of the user, and the operation contents of the 
equipment. Then the interaction data matching with the 
detected real conditions of the user, the estimated user 
demands, the present personal information of the user, 
and the speech key word of the user inputted through a 
microphone is retrieved from the database. According to 
the contents described by the item of the 'operation 
contents' in the interaction database, speech is made from a speaker, and another apparatus 
such as apparatus for information retrieval is operated. Therefore, it is possible to achieve the 
operation of apparatus adapted to meet the demands of the user. 
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* NOTICES * 

Japan Patent Office is not r s(K)nsible for any 
damages caused by the use of this translation. 

1 . This document has been translated by computer.So the translation may not r fleet the original 
precisely. 

2. shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The control unit which operates a predetermined device according to the information 
which was equipped with an input means characterized by providing the following to input the 
information in which the intention of a user to this user was reflected, and was inputted by this 
input means. A situation detection means to detect the situation that the user is placed. 
Information inputted by the aforementioned input means. A data-storage means for an activity 
setup by which the data for an activity setup for setting up the activity of the aforementioned 
device were memorized from the situation detected by the aforementioned situation detection 
means. A setting means will set up the activity as activity of the aforementioned device if the 
activity corresponding to the information inputted by the aforementioned input means and the 
situation detected by the aforementioned situation detection means is searched from the 
aforementioned data for an activity setup and there is corresponding activity, and an appliance- 
control means operate the aforementioned device according to the activity set up by this setting 
means. 

[Claim 2] The control unit according to claim 1 characterized by providing the following. 
Information inputted by the aforementioned input means. The situation detected by the 
aforementioned situation detection means. Information inputted into the aforementioned data- 
storage means for an activity setup by the aforementioned input means while having a demand 
presumption means to presume a demand of a user, based on at least one of the activity of the 
aforementioned device by the aforementioned appliance control means. The demand by which 
the aforementioned presumption is carried out among the situation detected by the 
aforementioned situation detection means, and the demand presumed by the aforementioned 
demand presumption means. 

[Claim 3] The control unit according to claim 2 characterized by providing the following. 
Information inputted into the aforementioned data-storage means for an activity setup by the 
aforementioned input means while having an individual information-storage means to memorize a 
user s personal information. The situation detected by the aforementioned situation detection 
means. The demand presumed by the aforementioned demand presumption means. Among the 
personal information memorized by the aforementioned individual information-storage means, it 
is the aforementioned personal information. 

[Claim 4] The control unit characterized by having a change means to change the data for an 
activity setup of the above 3rd in a control unit according to claim 3 according to the personal 
information memorized by the aforementioned individual information-storage means. 
[Claim 5] In a control unit according to claim 4 for the aforementioned individual information- 
storage means While two or more man-minutes personal information is memorized, out of the 
two or more man-minutes personal information memorized by the aforementioned individual 
information-storage means It has a discernment means to specify the pr s nt user s p rsonal 
information, further the afor mention d change means It is the control unit which changes the 
data for an activity s tup of the above 3rd according to the personal information specified by th 
aforem ntioned discernment means, and is characterized by using for the aforem ntioned s tting 
means the p rsonal information specified by th afor m ntioned disc mment m ans when 
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searching activity from the data for an activity setup of the abov 3rd. 

[Claim 6] In a claim 1 or a control unit according to claim 5 for th aforem nti n d data-storage 
means for an activity setup Only from the situation detected by the aforem ntion d situation 
detection means, the 4th data for an activity setup for setting up the activity of the 
aforementioned device is memorized, the aforementioned setting m ans The control unit which 
will be characterized by setting up the activity as activity of the aforementioned device if the 
activity corresponding to the situation detected by the aforementioned situation detection 
means is searched from the data for an activity setup of the above 4th and there is 
corresponding activity. 

[Claim 7] It is the control unit which the aforementioned input means inputs the keyword which 
the user uttered as the aforementioned information in a claim 1 or a control unit according to 
claim 6, and is characterized by the bird clapper from the device for voice outputs for the 
aforementioned device outputting voice, and other devices. 



[Translation done.] 
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* NOTICES * 

Japan Patent Off ic is not r sponsible for any 
damages caused by the use of this translation. 

1. This docum nt has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention relates to the control unit which 
operates predetermined devices, such as a device for information retrieval, and a device for 
voice outputs, according to the input in which the intention of users, such as utterance, a key 
stroke input, etc. of a user, was reflected. 
[0002] 

[Description of the Prior Art] That to which a user performs operation corresponding to the 
voice command by uttering the language beforehand defined as a voice command as navigation 
equipment for recent years, for example, automobiles, is put in practical use. 
[0003] For example, when a user utters the voice command a "present location", while the 
control section which consists of a microcomputer which accomplishes the center of the 
equipment concerned makes devices for information retrieval, such as a CD-ROM drive, search 
the name of a place, an institution, etc. near a its present location with this kind of equipment, it 
is made to make the voice for guidance "it is near OO" output from the device for voice outputs 
which consists of a loudspeaker etc. based on the reference result. 
[0004] Moreover, when the name of a place is uttered, while the control section of the 
equipment concerned, for example, makes the device for information retrieval search the 
circumference map of the name of a place by which utterance was carried out [ above- 
mentioned ] after a user utters the voice command "map reference", it is made to display the 
circumference map of the name of a place by which utterance was carried out [ above- 
mentioned ] on the device for a display which consists of CRT etc. based on the reference 
result. 
[0005] 

[Problem(s) to be Solved by the Invention] However, with the above-mentioned conventional 
equipment, the activity (namely, the content of reference what to search) of the device for 
information retrieval, the activity (namely, the content of utterance with voice) of the device for 
voice outputs, etc. are set to one to one voice command. Therefore, in order to obtain device 
operation (the content of reference, the content of utterance, etc.) desired truly, the user did 
not have to be able to utter more voice commands and was not able to get desired device 
operation in many cases. 

[0006] For example, suppose that it programmed temporarily in equipment conventionally so that 
control action of searching the restaurant near a its present location to the utterance keyword 
of users, such as "a restaurant and reference", and guiding this reference result with voice 
might be performed. However, when vehicles are running the highway in the case of this example, 
even if a user wants to come to have a meal and it speaks with "a restaurant and reference", 
the restaurant which can go only from an ordinary road will be shown and it will becom 
meaningless information offer. 

[0007] In addition, such a problem is the sam also about the case where a user inputs his 

int ntion not only when inputting his intention by utterance, but by the key stroke input etc. this 

inv ntion is made in view of such a probi m, is the f w r input from a user and aims at off ring 
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the control unit which can r aliz d vice operation adapted to th request of th us r. 
[0008] 

[A The means for solving a technical problem and an ffect of th invention] Th control unit of 
^ this invention according to claim 1 made in order to attain the above-mentioned purpose is 
equipp d with an input means Ml to input the information in which the intention of a us r to this 
user was reflected, and op rates the predetermined d vice M3 according to the information 
(henceforth input) inputted by the input means Ml so that it may illustrate to drawing 1 , 
[0009] In addition, various things, such as a device for communication by the device for 
information retrieval with which information is searched from a predetermined database as a 
device M3, the device for voice outputs which outputs voice, radio, or the cable, aii^conditioning 
equipment, audio equipment, such as television and a tape recorder, devices for a display, such 
as CRT and liquid crystal, and a lighting device, can be considered. And you may be one, and two 
or more devices M3 which the control unit concerned operates may reach, and the number of 
them may be [ two or more ]. 

[0010] Moreover, as information which the input means Ml inputs, various things, such as a 
keyword of the voice which the user uttered, and information by a user s key stroke or switch 
operation, can be considered. Furthermore, you may make it include no inputting (getting it 
blocked and a user not inputting information intentionally) as information which the input means 
M1 inputs. ' 

[0011] Especially the control unit of this invention is equipped with a situation detection means 
M5 to detect the situation that the user is placed, and the data-storage means M7 for an 
activity setup, and the data D1 for an activity setup for setting up the activity of a device MS 
are memorized by the data-storage means M7 for an activity setup here from the information 
inputted by the input means Ml, and the situation detected by the situation detection means M5. 

[001 2] And if there is activity to which the setting means M9 searches the activity 
corresponding to the information inputted by the input means Ml and the situation detected by 
the situation detection means M5 from the aforementioned data D1 for an activity setup, and 
corresponds, the activity will be set up as activity of the aforementioned device M3. Then, the 
appliance control means Mil operates a device M3 according to the activity set up by the 
aforementioned setting means MS, In addition, in this invention, the contents of a do-nothing 
operation (it is got blocked and don't operate a device M3) are also included as activity of a 
device M3. 

[001 3] According to the control unit of such this invention, according to the situation that not 
only the input from a user inputted by the input means Ml but the user is placed, the activity of 
a device M3 is changeable. That is, even if the input from a user is the same, according to the 
situation that the user is placed, activity of a device M3 can be made the optimal. Therefore, 
device operation adapted to the request of the user is realizable by the fewer input from a user. 
[0014] The control unit according to claim 2 is added and equipped with the demand presumption 
means Ml 3 to the control unit according to claim 1 so that it may illustrate to drawing 1 . next, 
this demand presumption means Ml 3 A demand of a user is presumed based on at least one of 
the information inputted by the input means Ml, the situation detected by the situation 
detection means M5, and the activity of the device M3 by the appliance control means Mil. 
[0015] And the 2nd data D2 for an activity setup for setting up the activity of a device M3 is 
further memorized by the data-storage means M7 for an activity setup from at least two or more 
items including the demand presumed by the demand presumption means M13 among the 
information inputted by the input means Ml, the situation detected by the situation detection 
means M5, and the demand presumed by the demand presumption means Ml 3. 
[0016] The setting means MS and among the information inputted by the input means Ml, the 
situation detected by the situation detection means M5, and th demand presumed by th 
demand presumption means Ml 3 If the activity corresponding to at least two or more it ms 
including the demand presumed by the demand presumption means Ml 3 is searched from the 
data D2 for an activity setup of the above 2nd and th re is corresponding activity, th activity 
will be set up as activity of a device M3. 
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[001 7] That is, a demand of a user is pr sum d has d on at I ast one of the input from a us r, 
the situation detected by th situation d tection means M5, and the activity of the device M3 by 
the appliance control means Mil, and it is made to set up the activity of a devic MS for a 
• demand of the user who presumed as one of the parameters in a control unit according to claim 
2. 

[0018] Therefore, according to such a control unit according to claim 2. device operation bas d 
' more on the request of a user is realizable. In addition, what is necessary is just to set up 
beforehand the data D1 for an activity setup, and the 2nd data D2 for an activity setup 
exclusively so that the activity from which the setting means M9 differs simultaneously from 
each data D1 and D2 may not be discovered. Moreover, when the priority of reference was 
prepared in each data D1 and D2, and the setting means M9 searches every one to the activity 
of each data D1 and D2 according to the priority and has the corresponding activity, you may 
make it set up the activity as activity of a device MS, 

[0019] Next, the control unit according to claim S is added and equipped with an individual 
information-storage means M15 to memorize a users personal information, to the control unit 
according to claim 2 so that it may illustrate to drawing 1 . Further and for the data-storage 
means M7 for an activity setup Among the information inputted by the input means Ml, the 
situation detected by the situation detection means M5, the demand presumed by the demand 
presumption means MIS, and the personal information memorized by the individual information- 
storage means Ml 5 From at least two or more items including the personal information 
memorized by the individual information-storage means Ml 5, the 3rd data DS for an activity 
setup for setting up the activity of a device MS is memorized. 

[0020] The setting means M9 and among the information inputted by the input means Ml, the 
situation detected by the situation detection means M5, the demand presumed by the demand 
presumption means MIS, and the personal information memorized by the individual infomnation- 
storage means Ml 5 If the activity corresponding to at least two or more items including the 
personal Information memorized by the individual information-storage means Ml 5 is searched 
from the data DS for an activity setup of the above 3rd and there is corresponding activity, the 
activity will be set up as activity of a device MS. 

[0021] According to such a control unit according to claim 3, by memorizing the personal 
information of the user who actually uses the equipment concerned for the individual 
information-storage means Ml 5, the user's personal information is set to one of the parameters, 
and the activity of a device MS will be set up. Therefore, according to this control unit, device 
operation adapted to the request peculiar to a user can be realized, and it is advantageous. 
[0022] In addition, what is necessary is just to set up beforehand the data D1 for an activity 
setup, the 2nd data D2 for an activity setup, and the Srd data DS for an activity setup 
exclusively so that the activity from which the setting means M9 differs simultaneously from 
each data D1, D2, and DS may not be discovered. Moreover, when the priority of reference was 
prepared in each data D1, D2, and DS, and the setting means M9 searches every one to the 
activity of each data D1, D2, and D3 according to the priority and has the corresponding activity, 
you may make it set up the activity as activity of a device MS. 

[002S] Next, the control unit according to claim 4 is added and equipped with the change means 
Ml 7 to the control unit according to claim S so that it may illustrate to drawin g 1 . And the 
change means Ml 7 changes the data DS for an activity setup of the above Srd according to th 
personal information memorized by the individual information-storage means Ml 5. 
[0024] According to such a control unit according to claim 4. device operation which actually 
uses the equipment concerned and which could change the activity of a device MS and was 
further based on the request peculiar to a user for every user is realizable. A control unit 
according to claim 5 is set to a control unit according to claim 4 so that it may illustrate to 
drawin g 1 . next, for the individual information-storage m ans Ml 5 While two or more man- 
minut s personal information is m morized, it has a discernment m ans Ml 9 to specify th 
present user s personal information, out of the two or more man-minutes personal information 
memorized by the individual information-storage means Ml 5. 

[0025] And the change means Ml 7 changes the data DS for an activity s tup of th above 3rd 
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according to the personal information sp cified by the disc mm nt m ans Ml 9, and in cas the 
setting means M9 searches activity from the data D3 for an activity s tup of th above 3rd, the 
personal information specified by the aforem ntioned disc mment means Ml 9 is used for rt 
. [0026] According to this control unit according to claim 5, even if which man of two or more 
persons personal information was remembered to be by the individual information-storage m ans 
M15 uses the equipment concerned, he can acquire the ffect by the control unit according to 
claim 4. Next, in the control unit according to claim 6, in the control unit according to claim 1 to 
5, the 4th data D4 for an activity setup for setting up the activity of a device M3 is memorized 
only from the situation detected by the situation detection means M5 by the data-storage 
means M7 for an activity setup so that it may illustrate to drawin g 1 , 
[0027] And if the setting means M9 searches the activity corresponding to the situation 
detected by the situation detection means M5 from the data D4 for an activity setup of the 
above 4th and has the corresponding activity, the activity will be set up as activity of a device 
M3. That is, in the control unit according to claim 6, the activity of a device M3 is made to be set 
up only from the situation detected by the situation detection means M5. 
[0028] When the situation that the user is placed turns into a specific situation according to 
such a control unit according to claim 6, irrespective of other factors, such as input from a user, 
a device M3 can be operated in predetermined activity, and it is advantageous. For example, 
when it has the device for voice outputs which outputs voice as a device M3, warning with voice 
etc. can be performed to a user in a specific situation. 

[0029] In addition, what is necessary is just to set up beforehand the 4th data D4 for an activity 
setup, and other data for an activity setup (D1, D2, D3) exclusively so that the activity from 
which the setting means M9 diipfers simultaneously from each data may not be discovered. 
Moreover, you may prepare the priority of reference in the 4th data D4 for an activity setup, and 
other data for an activity setup (D1, D2, D3). 

[0030] Next, in a control unit according to claim 7, the input means Ml inputs the keyword which 
the user uttered in a control unit according to claim 1 to 6 as the aforementioned information 
(information in which the intention of a user was reflected). And a device M3 consists of a device 
for voice outputs for outputting voice, and other devices. 

[0031] According to such a control unit according to claim 7, the appliance control equipment of 
the interactive mode which operates other devices other than the device for voice outputs can 
be easily constituted according to the contents of a setting of each data D1-D4 for an activity 
setup which the data-storage means M7 for an activity setup is made to memorize, conversing 
with a user with voice. It becomes information offer equipment of the interactive mode which can 
offer exactly the information which the device for information retrieval with which information is 
searched from a predetermined database, then a user expect a device besides the above 
^specially. 
[0032] 

[Embodiments of the Invention] Hereafter, the operation form of this invention is explained using 
a drawing. Drawin g 2 is a block diagram showing the composition of the control unit 1 of an 
operation form first. In addition, the control unit 1 of this operation form controls various devices 
carried in the vehicles, being carried in an automobile (vehicles) and having a dialog with the 
crew (mainly operator) and voice of vehicles as a user. 

[0033] As shown in drawing 2 , the control unit 1 of this operation form The input unit 3 for a 
user inputting various kinds of instructions, data, etc. by external operation. The microphone 5 
for inputting voice, and the loudspeaker 7 for outputting voice, The navigation equipment 9 of the 
common knowledge which performs detection, path guidance, etc. of the current position (its 
present location) of vehicles. The display 1 1 for displaying a picture, and the air-conditioner 
equipment 1 3 which controls air-conditioning in the car, The audio equipment 1 5 which consists 
of a cassette tape recorder, CD (compact disk) player, MD (mini disc) player, radio, television, 
etc.. The broadcast terminal of well-known VICS (Vehicle Information and Communication 
System), The communication device 1 7 which performs data communication by radio b twe n 
th Internet broadcast terminals which are conn ction windows with the Internet, It conn cts 
with the various sensors 1 9 for det cting v hid s op rational status, such as the vehicle speed 
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and an acc leration-and-dec I ration state, the t mp ratur of vehici s insid and utside, the 
existence of a raindrop, to., and other control units (illustration abbr viation) which control the 
door lock of vehicles, a windowpane (power window), an engine, a brake gear, etc. 

^ [0034] In addition, navigation equipment 9 is equipped with the op ration key for th CD-ROM 
drive for reading data and a user inputting instructions etc. from CD-ROM which m morized data 
for path guidance, such as GPS equipm nt of the common knowledge for d tecting the current 

' position of vehicles, and map data, name of a place data, institution name data, and its CD-ROM. 
And if the instructions which direct the path guidance to the destination and the destination 
through an operation key from a user are inputted, navigation equipment 9 will display a road map 
including the optimal path for resulting to the current position and the destination of vehicles on 
display 11, and will perform path guidance. Moreover, if the road map for path guidance is not 
only displayed, but various pictures, such as a menu for infonnation retrieval, are displayed on 
display 1 1 and audio equipment 1 5 is further set as the mode of television with navigation 
equipment 9. the receiving picture of television received by the television tuner with which the 
audio equipment 15 was equipped will be displayed on it. 

[0035] And the system control section 21 constituted centering on the microcomputer with 
which a control unit 1 consists of CPU, a ROM, RAM, etc.. The interface 23 which inputs the 
instructions and data from an input unit 3 into the system control section 21 (I/F), The voice 
input section 25 which changes into digital data the sound signal inputted from the microphone 5, 
and is inputted into the system control section 21, The speech synthesis section 27 to which 
the text data outputted from the system control section 21 is changed into the sound signal of 
an analog, it outputs to a loudspeaker 7, and singing of the loudspeaker 7 is carried out. It has 
the above-mentioned navigation equipment 9, display 11, air-conditioner equipment 13, audio 
equipment 15, a communication device 17, the various sensors 19, and the appliance control 
interface (appliance control I/F) 29 that connects other control units and system control 
sections 21 possible [ data communication ]. 

[0036] Moreover, the control unit 1 is equipped with the Internet address database 31 which 
memorizes the address (Internet address) of the Internet, and the reference control section 33 
in order to search and acquire the information on desired from the Internet by the 
communication device 1 7. And when the system control section 21 outputs the reference 
keyword showing the contents of reference (contents) to the reference control section 33. the 
r-eference control section 33 operates a communication device 17 through appliance control 
I/F29. searches the information corresponding to the above-mentioned reference keyword from 
the Internet broadcast terminal, and makes the reference result input into the system control 
section 21. Moreover, in the Internet address database 31, the Internet address used by the 
reference control section 33 in the past is memorized by the instructions from the system 
Qontrol section 21, and the reference control section 33 will reuse the Internet address in the 
Internet address database 31. if the same reference keyword as the reference keyword inputted 
in the past is received from the system control section 21. 

[0037] In addition, with this operation form, it is equivalent to the device M3, and hereafter, a 
loudspeaker 7, navigation equipment 9, the CD-ROM drive (illustration abbreviation) with which 
the navigation equipment 9 was equipped, display 11, air-conditioner equipment 13, audio 
equipment 1 5, a communication device 1 7, and other control units (illustration abbreviation) 
name these generically, and call it a device M3. Moreover, among these devices M3, a 
loudspeaker 7 is equivalent to the device for voice outputs, and except [ it ] is equivalent to 
other devices. 

[0038] And the utterance further outputted to a controtunit 1 from a loudspeaker 7 As a means 
to memorize the data for setting up the contents (namely, activity of a loudspeaker 7) of (also 
calling it agent utterance hereafter), and the activity of a device b sides the above of thos 
other than loudspeaker 7 It has the dialog data-storage section 35 which memorizes a dialog 
database, and the user profil storage section 37 which memorizes a user s two or more man- 
minutes personal information (henceforth a user profile). In addition, the Int m t address 
database 31 mentioned above with this dialog data-storage section 35 and the us r profile 
storage section 37 is constitut d by the non-volatile m mory in which read-out and the writing 
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of data are possible. 

[0039] Here, the dialog database memorized by the dialog data-storage section 35 and the us r 

profile memorized by th user profile storage section 37 are explained. First, the information that 
^ the user profile as personal information memorized by the user profile storage section 37 is 

peculiar to a user about each item, such as the following - (P-1) (P-1 1), is described. 

[0040] (P-1): Classifications of the man (general, the president, a young man, sex. etc.). 
' (P-2): Other identification information other than a name or the name for discriminating the man 

further (a password, identification number, etc.). 

(P-3): Birth date (birthday). 

[0041] (P-4): Hometown. 

(P-5): Address. 

(P-6): Occupation. 

(P-7): Executive. 

[0042] (P-8): Hobby. 

(P-9): The place which goes by the purpose of a hobby well. 
(P-10): The place which goes by the purpose of shopping well. 
(P-11): Family composition, a family's name, and a family's birth date. 

[0043] In addition, this user profile is memorized by the user profile storage section 37 by write- 
in operation of the system control section 21. when a user operates an input unit 3 and inputs 
the contents of each above-mentioned item. Next, the dialog database memorized by the dialog 
data-storage section 35 has the data structure of a tabular format for the example, as shown in 
drawing 4 - drawing 8 . And it sets to drawing 4 - drawing 8 , and they are each lateral lines Ll- 
L23. It is 1 set of dialog data, and the dialog database consists of plurality of such dialog data. In 
addition, at drawing 4 - drawing 8 , they are each lines L1-L23. It is continued and expressed to 
two steps. 

[0044] Namely, each set talk data which constitute a dialog database The item of a classification 
of the dialog data, and two or more items showing the situation that the user is placed (with this 
operation form) The environment of a season, a time zone or time, the destination, a its present 
location, and the circumference of vehicles, the situation outside a vehicle, and an in-the-car 
situation. The item of a demand of a user, the item of a user's condition, and the item of a user's 
personal information, The item of the utterance (henceforth user utterance) of a user inputted 
through a microphone 5 and the voice input section 25. The item of the activity at the time of 
the control unit 1 concerned operating a device M3 (the contents of agent utterance, and 
activity of other devices other than loudspeaker 7), It has the data area for describing 
corresponding contents about each of the item of the presumed demand which is a demand of a 
user presumed, the item of the presumed state which is in a user's state presumed, and the item 
pf the presumed related demand which are other demands of a user presumed. And each set talk 
data describe the contents corresponding to the data area of each above-mentioned item. In 
addition, description means that the data showing the contents corresponding to the data area 
secured beforehand are set. 

[0045] Here, each item of such a dialog database is explained concretely. 

(C-1): The contents as which the dialog data expresses whether it is a thing about what subject 
in a dialog with a user are beforehand described by the item of a classification "a classification", 
and the contents showing the classification of the agent utterance described by the item of 
"activity" mentioned especially later are described. 

[0046] although there are a greeting, appreciation, a family, a meal, a parking lot. path guidanc . 
reference, shopping, a hobby, device operation, etc. and illustration is not further carried out as 
contents described by and this item of "classification", for example so that it may illustrate to 
drawin g 4 - drawing 8 — in addition, introduction, a sport, and the destination — it asks a 
question and checks, and it suits and *3Me*, a halt, an end, etc. are 

[0047] (0-2): The cont nts which subdivided furth r the four seasonses, such as any, eariy 
summer, midsummer, etc. of the four seasons, such as spring, summer, autumn, and winter, are 
beforehand d scrib d by the seasonal "a s ason" it m. 

(C-3): The contents of the concret time zone called daytime, night eariy morning, midnight, tc. 
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and wh n to when or the detail d time of what minut is described wh n by the item of a time 

zone or time "a time zone or time" on what [. what / month / what ] in the morning. 

[0048] And the item of this "time zone or time" has that the cont nts are b forehand described 
^ to be, and the thing the system control section 21 describes the cont nts to be serially. For 
xample. the line LI 5 illustrated as the lin s L1-L3 and the dialog data of L7 which are 

illustrated to drawing 4 to drawing 6 and LI 6 In dialog data, the contents showing a time zone 
" are beforehand described by the item of "a time zone or time." moreover, jine L1 1 illustrated to 

drawing 5 a dialog — data — setting — " — a time zone — or — time — " ~ an item — it can 

set — < — > — inside — **** — system control — the section — 21 — present — time — 

serially — updating — having — describing — having . 

[0049] (C-4): The destination which a user means is described by the system control section 21 
by the item of the destination "the destination." In addition, the system control section 21 reads 
the destination set up by the user from navigation equipment 9. or acquires the content which 
should be described in the item of the "destination" according to the content of a dialog with, 
the user till then. 

[0050] And the item of this "destination" has some which are not described to be that the 
content is described to be. the line LI 2 illustrated to drawing 5 and LI 3 a dialog — data — 
setting — " — the destination — " — an item — it can set — < — > — inside — **** 
system control — the section — 21 — till then — a user — a dialog — the content — having 
responded — the destination — describing — having . [ for example, ] Moreover, the above- 
mentioned line LI 2 illustrated to drawing 4 - drawing 8 and LIS The content is described by the 
item of the "destination" in the dialog data of an except 

[0051] (C-5): The present location of vehicles is described by the system control section 21 by 
the item of a present location "a present location." In addition, the system control section 21 
reads the present location of vehicles from navigation equipment 9. and acquires the content 
which should be described in the item of a "present location." 

[0052] And the item of this "present location" has some which are not described to be that the 
content is described to be like the item of the "destination." line L1 1 -LI 3 [ for example, ] 
illustrated to drawing 5 a dialog — data — setting — " — a present location — " — an item 
it can set — < — > — inside — *aMc* — system control — the section — 21 — vehicles — a 
present location ~ describing — having . Moreover, above-mentioned line L11 -LI 3 Hlustrated 
to drawing 4 - drawing 8 The content is described by the item of a "present location" in the 
dialog data of an except 

[0053] (C-6): The content showing the environment of the circumference of vehicles is 
beforehand described by the environmental "environment" item. Specifically, the content 
showing passage environment the content (it is easy to slide on a road surface freeze and a 
road surface) showing a passage (highway, ordinary-road, national highway, prefectural road, etc.) 
state, the contents (a speed limit one-way traffic, DO NOT ENTER, etc.) showing traffic 
environment and the contents (the inside of the mountain where the sea is near, and a town, 
before a station, etc.) showing geography environment are described beforehand. 
[0054] (0-7): The content showing the situation outside a vehicle is beforehand described by the 
item of the situation outside a vehicle "the situation outside a vehicle." The content which 
specifically expresses the weather of a its present location (being fine cloudiness, a light rain, 
rain, heavy rain. snow, thunder, a typhoon, etc.). The contents (being fine cloudiness, a light rain, 
rain, heavy rain. snow, thunder, a typhoon, etc.) showing the weather of the destination, the 
contents (traffic congestion, the occurrence of accident which it is congested and has become 
empty a little) showing a traffic situation, and the contents (those with passing vehicles, those 
with flattery vehicles, those with precedence vehicles, etc.) showing a vehicles circumference 
situation are described beforehand. In addition, as a content showing a vehicles circumference 
situation, the classification (a truck, a passenger car. motorbike, etc.) of passing vehicles or 
flattery vehicles can also b added and describ d. 

[0055] (C-8): The cont nt showing a situation in the car is b forehand described by th it m of 
an in-the-car situation "an in-the-car situation." The cont nt which sp cifically expresses 
operational status (a run by the congest d passage, a comfortable run, those with scillating, 



I 
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spe d ov r, etc.). the cont nt (one p rson and two persons — many (thr or more p rsons) — 
a family companion — or further) showing an entrainment state Contents showing the degree of 
vehicle room air temperature, such as a detailed content what man is sitting on which seat, the 

♦ contents (a drive, with a family, a drive with a fri nd, date with a sweetheart etc.) showing th 
move purpose, the content showing audio environment, etc. ar described b forehand. 
[0056] (C-9): The content showing the demand considered that a user has in the item of a 

* demand "a demand" is described beforehand. Specifically, the content of air-conditioner 
operation needlessness etc. which lowers a meal, a drink, shopping, a drive, a break, play, a park, 
an amusement park, a theme park, boring, tennis, a pool, a jogging, sea bathing, skiing, golf, golf 
course reservation, path guidance, a parking lot and air-conditioner setting temperature and 
which raises air-conditioner setting temperature is described. 

[0057] (C-10): The content showing the mental state or corporal state considered that a user 
becomes is beforehand described by the item of a state "a state." concrete — hungry — being 
hungry — before — movement ^ preparation (it is going to move — a state) — good condition 

- usual — being hot — a throat — a dry — energy — lively — a drive — enjoying oneself — 
**** — a meal — inside — music — appreciation — inside — television — appreciation — 
inside — a full stomach — defatigation — returning — ** — playing — — eariy — the 
destination — reaching — — a break — inside — being irritated — **** — getting angry — 

[0058] (C-1 1): The content of the item relevant to the content of description of other items 
(especially, "a classification", "a demand", "user utterance", "activity") in the dialog data is 
described by the item of personal information "personal information" among each item (P-1 to 
P-1 1 ) of a user profile mentioned above. 

[0059] And there are that the content of fixation is beforehand described to be as an item of 
this "personal information", and a thing by which the content of description is changed by the 
system control section 21 according to the user profile actually memorized by the user profile 
storage section 37. For example, in the dialog data of the line L8 illustrated to drawin g 4 . the 
content (this example those with a child) corresponding to the item of the (P-1 IrFamily 
composition) of a user profile is beforehand described by the item of "personal information. 
Moreover, in the dialog data of the line LI 7 Illustrated to drawing 6 . the content (at this 
example, skiing is a hobby) corresponding to the item of a (P-8:hobby) of a user profile is 
beforehand described by the item of "personal information." 

[0060] on the other hand, line LI 6 illustrated to drawing 6 a dialog — data — setting — " — an 
individual — information — " — an item — it can set — i — ] — inside — **** — system 
control — the section — 21 — a user profile — ( — P - ten — : — shopping — the purpose 
good — going — a place — ) — an item — describing — having had — the content (this 
example A department store) — describing — having . moreover, line LI 8 illustrated to drawing 6 
a dialog — data — setting — " — an individual — information — " — an item — it can set 
[ — ] — inside — **** — system control — the section — 21 — a user profile — ( — P - nine - 

- : — a hobby — the purpose — good — going — a place — ) — an item — describing 
having had — the content (this example D golf course) — describing — having . 

[0061] the above-mentioned line LI 6 and LIB " — an individual — information — " — an item - 

- 9Me^ — beforehand — a user profile — each — an item — inside — any — an item 
describing — having had — the contents ~ [ — ] — inside — describing — a thing — being 
shown — directions — data — setting — having — **** — system control — the section — 
21 — the above — directions — data — being based — " — an individual — information — " 
an item Therefore, the above-mentioned line LI 6 and LI 8 The contents of description of the 
item of "personal information" will be changed into the user profile storage section 37 according 
to the actually memorized user profile. 

[0062] In addition, the above-mentioned line LI 8 The contents of a hobby in golf ar also 
beforehand described by th item of the "personal information" in dialog data. 
(C-1 2): The keyword under utterance of the user expect d to be inputted through a microphon 
5 and the voice input section 25 is beforehand described by the it m of user utteranc "user 
utterance." And with this operation form, the keyword group described by the item of this "user 
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utterance" s rves as a r cognition vocabulary of the control unit 1 cone mad. 

[0063] However, line L1 1 illustrated to drawing 5 The keyword described in < <» according to 

the item of "user utterance" in dialog data is a variable data supposing the proper noun showing 

w the name of a place being inputted, and the keyword describ d in □ is a variable data supposing 
the language showing the kind of cooking b ing inputted. Moreover, line LI 7 illustrated to drawing 
6 The keyword d scribed in < <» according to the item of "user utt ranee" in dialog data is a 

" variable data supposing the proper noun showing the name of a mountain being inputted. 

[0064] (C-1 3): The activity of the device M3 corresponding to the contents which the activity at 
the time of the control unit 1 concerned operating a device M3 (the contents of the agent 
utterance which should be outputted from a loudspeaker 7, and activity of other devices other 
than loudspeaker 7) is beforehand described, and described by the dialog data especially in the 
above (C-1) of - (C-1 2) and each item is described by the item of activity "activity." 
[0065] For example, while making the CD-ROM drive or communication device 1 7 with which 
navigation equipment 9 was equipped search a nearby restaurant from a its present location in 
the item of "activity", is it "meal from a loudspeaker 7 in the dialog data of the line L9 illustrated 
to drawing 5 . based on the reference result? this — if it becomes closely, there is a store of the 
<a>, <b>. <c>. etc. affair <X1> Where does it eat? The activity of the device M3 of making the 
agent utterance " output is described beforehand. In addition, a communication device 1 7 is 
made to communicate with the Internet broadcast terminal, and is made to search required 
information from the Internet. 

[0066] Moreover, line L10 illustrated to drawing 5 In dialog data in the item of "activity" Whil 
making the above-mentioned CD-ROM drive or a communication device 17 search two near 
parking areas (or service area) from a its present location If it is an after «e> parking area from 
a loudspeaker 7 to "<d> parking area based on the reference result, it is a part for after <X3 >. 
[ of a part for X2 >, and a degree ] The activity of the device M3 of making the agent utterance 
" output is described beforehand. 

[0067] Furthermore, for example, in the dialog data of the line LI 9 illustrated to drawin g 7 , the 
degree of "room air temperature is over 40 degrees C from the loudspeaker 7 in the item of 
"activity." Air-conditioner setting temperature is lowered. While making the agent utterance " 
output, the activity of the device M3 of making the temperature of the vehicle interior of a room 
lowered to air^conditioner equipment 1 3 is described beforehand. 

[0068] in addition — drawing 5 — and — drawing 6 — setting — " — activity — " — an item — 
indicating — having had • — < — > ' — inside — a character — inside — a — from — k — up to 
— the alphabet — O — O — a restaurant — and — C — a mountain — a skiing area — The 
proper noun obtained by reference operation (specifically, a, b. c, f, and 00 restaurant) The 
searched restaurant name, the parking-area name with which d and e were searched, the parking 
Ipt name with which g was searched, the passage name with which h and i were searched, and 
the shopping center name with which j and k were searched — it is — XI from — X5 up to 
the sign which starts in X Numeric values acquired by reference operation, such as a number 
and time It is (the numeric value which specifically expresses the time of the restaurant f wh re 
the numeric value showing the total number of cases, such as the restaurants a, b, and c wh re 
XI was searched, X2, the numeric value showing the duration to the parking areas d and e with 
which Xthree was searched, X4. and X5 were searched which can be reserved). 
[0069] As an item of "activity", there are some by which the contents of description are 
changed by the system control section 21 according to the user profile actually memorized by 
the user profile storage section 37 like the item of "personal information" .on the other hand 
further. ** for example, line LI 6 illustrated to drawing 6 □ [ in / the item of "activity" / on 
dialog data and ] — inside, the contents (this example A department store) described by the 
(item which goes by the purpose of P-10:shopping well) of a user profile are describ d by th 
system control section 21 mor over, line LIB illustrated to drawing 6 □ [ in / the item of 
"activity" / on dialog data and ] — inside, the contents (this example D golf course) d scrib d 
by the (item which goes by th purpose of a P-9:hobby well) of a us r profile are describ d by 
the system control section 21 

[0070] the above-mentioned line LI 6 and LIS " — activity — " — an item — **3Mc — 
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beforehand — a user profile — each — an item — inside — any — an it m — d scribing — 
having had — the content — [ — ] — inside — describing — a thing — being shown — 
directions — data — setting — having — stoMe* — system control — the s ction — 21 — the 
above — directions — data — being based — " — activity — " — an item — it can set — 
[ Therefore, the above-mention d line LI 6 and LI 8 The content of description of th item of 
"activity" (in the case of this example th content of agent utterance) will be changed into the 
user profile storage section 37 according to the actually memorized user profile. 
[0071] as the activity of the device M3 which the item of "activity" of the line LI 6 illustrated to 
drawing 6 shows when it explains concretely — above — D — while making a communication 
device 1 7 search from the Internet the target product of the bargain performed at A departm nt 
store described inside today, is it "A department store from a loudspeaker 7 based on the 
reference result? The bargain of OO (for example, electrical machinery supply) is done today. It 
becomes a thing of making the agent utterance " output moreover — as the activity of the 
device M3 which the item of "activity" of the line LI 8 illustrated to drawin g 6 shows — above - 
- □ — is it "D golf course from a loudspeaker 7 based on the content (D golf course) described 
inside? Is reservation status investigated? It becomes a thing of making the agent utterance " 
output. 

[0072] (C-14): In the item of a presumed demand "a presumed demand" While the actual 
situation that the user is placed turns into a situation described in the item (C-2 to C-8) of the 
situation in the dialog data A user utters the keyword described by the item (C-12) of "user 
utterance" in the dialog data. Furthermore, when it is assumed that device operation described 
in the item (C-1 3) of the "activity" in the dialog data was actually performed, the content of the 
demand sensibly considered that a user has is described beforehand. 

[0073] And the variation (kind) of the content described by the item of this "presumed demand" 
is the same as that of the content described by the item of a "demand" mentioned above. 
(C-1 5): In the item of a presumed state "a presumed state" While turning into a situation 
described in the item (C-2 to C-8) of the situation in the dialog data, the actual situation that 
the user is placed as well as the item of a "presumed demand" A user utters the keyword 
described by the item (C-12) of "user utterance" in the dialog data. Furthermore, when it is 
assumed that device operation described in the item (C-1 3) of the "activity" in the dialog data 
was actually performed, the content in the state where it is thought sensibly that a user 
becomes is described beforehand. 

[0074] And the variation of the content described by the item of this "presumed state" , is the 
same as that of the content described by the item in the "state" where it mentioned above. 
(C-1 6): The content of demand with the another content described in the item of "a presumed 
demand" in the dialog data among the demands sensibly considered that a user has in the item 
Qf a presumed related demand "a presumed related demand" based on the same assumption as 
the item of the above "a presumed demand" is described beforehand. 
[0075] And the variation of the content described by the item of this "presumed related 
demand" is the same as that of the content described by the item of a "demand" mentioned 
above. In addition, in this operation gestalt, although the content is described by all dialog data 
about two items of "a classification" and "activity" as shown in drawin g 4 - drawin g 8 , the 
content may not be described about other items. That is, the portion of the blank in drawing 4 - 
drawin g 8 shows that the content is not described. And according to the content described in 
the item of "activity", it should just determine whether the content is described in which items 
other than "a classification" and "activity." However, the corresponding content is described by 
at least one or more items among items other than "a olassification" and "activity.'' 
[0076] Next, in the control unit 1 of this operation gestalt constituted as mentioned above, the 
processing performed in the system control section 21 is explained using drawin g 3 . As shown in 
drawin g 3 , when vehicles are ignition switched off (illustration ellipsis) and a power supply is 
supplied to the control unit 1 cone med, the system control section 21 At Step (it is h reaft r 
described as "S") 1 10, it first minds any with an input unit 3. I/F23 and a microphone 5. and th 
voice input s ction 25 they are. The id ntification information (for xampi , a name, a password, 
an identification number, a card number, etc.) from the pr sent us r (us r) inputted as a key 
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input or voice is read. In addition, you may make it read the information on an ID card as 
identification information. 

[0077] And the user profile the contents (a name and other id ntification information) d scribed 
. by the item (P-2) mentioned above out of the two or more man-minutes us r profile memorized 
by the user profile storag section 37 in SI 20 continuing and whose identification information 
read by the above S110 correspond is specified, and the specified user profile is memorized to 
' the buffer area beforehand set up in RAM as the present user s user profile. 

[0078] And a content setup of the dialog database in the dialog data-storage section 35 is 
further performed in SI 30 continuing using the user profile memorized to the above-mentioned 
buffer area. That is. based on the directions data, the content of the user profile in the above- 
mentioned buffer area is described about the dialog data with which the directions data 
mentioned above among each set talk data which constitute a dialog database are set. the line 
LI 6 illustrated to drawing 6 by this processing of 8130 and LI 8 a dialog — data — it can set — 
" — an individual — information — " — " — activity — " — each — an item — [ — ] — inside - 
- present — a user — ^ being peculiar — the content — describing — having — *** * * *** . 
[and] 

[0079] Furthermore, in these SI 30. the content of the agent utterance described by the item of 
"activity" of a dialog database is changed to that from which a tone differs according to the 
instructions from a user inputted through an input unit 3 and I/F23. That is, in the control unit 1 
of this operation gestalt, the character on utterance of the equipment 1 concerned (tone) can be 
changed now into condition, such as the man in the street, the president, a young man, a friend, 
and a girl, corresponding to the instructions from a user. In addition, the content of the agent 
utterance illustrated to drawing 4 - drawing 8 is standard form when a user specifies the "man in 
the street." 

[0080] Next, in order that the system control section 21 may search the dialog data which suited 
the actual situation that the user was placed from the dialog database by processing after S220 
later mentioned in SI 40 Based on the data of the clock built in self, time (a year, the moon, a 
day, time), the present four seasons, a present time zone. etc. detect the actual situation 
corresponding to the "season" of a dialog database, and the item of "a time zone or time", and 
memorize the detection result to the above-mentioned buffer area. 

[0081] Moreover, the system control section 21 describes the present time in the item of the 
"time zone or time" about the dialog data (dialog data of the line L1 1 illustrated to drawin g 5 
with this operation gestalt) which need to describe the content in the item of "a time zone or 
time" among each set talk data which constitute a dialog database from these SI 40 as 
mentioned above. 

[0082] And while reading the present location of vehicles from navigation equipment 9 in SI 50 
Qontinuing, the destination whose intention the user has is read from navigation equipment 9, or 
it grasps according to the content of a dialog with the user till then, and the their present 
location and destination which were detected in this way are memorized to the above-mentioned 
buffer area. 

[0083] Moreover, the system control section 21 describes the actual destination in the item of 
the "destination" about the dialog data (the line L1 2 illustrated to drawin g 5 with this operation 
gestalt, and dialog data of LI 3) which need to describe the content in the item of the 
"destination" among each set talk data which constitute a dialog database from these SI 50 as 
mentioned above. Furthermore, the system control section 21 describes an actual present 
location in the item of the "present location" about the dialog data (dialog data of line L1 1 -LI 3 
illustrated to drawin g 5 with this operation gestalt) which need to describe the content in the 
item of a "present location" among each set talk data which constitute a dialog database from 
th se SI 50 as mention d above. 

[0084] Next, by the Internet reference through the communication device 1 7 etc., by the 
classification of following ** - **, the system control section 21 checks the seasonal event and 
event a its present location and near th d stination, and memorizes the r suit to the above- 
mention d buffer area SI 60 continuing. 

** : seasonal events common to the whole country, such as the N w Y ar and Christmas. 
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[0085] ** : the event held every year although a f stival etc. is local. 
^ : the vent h Id to a local and special schedule. 

And the dialog data whose content of description of the item of a "classification'' is "a greeting" 
among each set talk data which constitute a dialog database from SI 70 continuing The d t ction 
result memorized by the above-mentioned buffer area by processing of the above SI 40 and 
SI 50 out of (the dialog data of the lines L1-L6 specifically illustrated to drawin g 4 ) (a season, a 
time zone, time, the destination, its present location). The dialog data which suit most the 
detection result (the environment of the circumference of vehicles, the situation outside a 
vehicle, in-the-car situation) of the actual situation which was detected by the processing of 
S200 mentioned later and was memorized by the above-mentioned buffer area are searched. 
And the text data of the content of the agent utterance described by the item of "activity" of 
the searched dialog data is further outputted to the speech synthesis section 27, and the 
utterance for "good morning" and the greeting of "hello" (agent utterance) is made to output 
from a loudspeaker 7. 

[0086] For example, if the present time detected by the above SI 40 is from 4:00 before 1 1:00, 
the dialog data of the line LI illustrated to drawing 4 will be searched, and the utterance of 
"good morning" will be performed from a loudspeaker 7. Moreover, if the present time detected 
by the above SI 40 is from 1 1:00 before 18:00. the dialog data of the line L2 illustrated to drayyjng 

4 will be searched, and the utterance of "hello" will be performed from a loudspeaker 7. 
[0087] in addition, the 1 st time immediately after supplying a power supply to the control unit 1 
concerned, as for the processing for this greeting utterance of SI 70 — or it is carried out only 
when predetermined conditions when going ahead with a dialog with a user and going are 
satisfied further Next, the silent state where a sound signal is not inputted through a microphon 

5 and the voice input section 25 in SI 80 the system control section 21 When it judges and a 
sound signal is inputted within the above-mentioned fixed time (S180:NO), whether it continued 
more than fixed time set beforehand, and continued While extracting the keyword (utterance 
keyword) which the user uttered from the sound signal by which the input was carried out 

[ above-mentioned ] by progressing to SI 90, voice input processing which memorizes the 
extracted keyword to the above-mentioned buffer area is performed. And it progresses to S200 
after that 

[0088] Moreover, when it judges with the silent state having continued more than fixed time, and 
having continued by the above SI 80 (S180:YES). the contents of "being silent (or no response)" 
are memorized to the above-mentioned buffer area, and it progresses to it after that S200. And 
in S200, among the actual situations (real situation) that the user is placed, processing for 
detecting real situations other than the item detected by the above SI 40 and SI 50 (that is, time 
and being a real situation except spatial the environment of the circumference of vehicles, the 
situation outside a vehicle, and each fruit situation of an in-the-car situation) is performed, and 
the detection result is memorized to the above-mentioned buffer area. 
[0089] inside [ being described by each item of "environment" of a dialog database, "the 
situation outside a vehicle", and a "in-the-car situation" by processing of S200 here ] ** — 
and a real situation are detected just For example, the real situation of the road environment 
any, such as a highway, an ordinary road, a national highway, and a prefectural road, the roads 
under present run are among "environment" of the circumference of vehicles. The real situation 
of the traffic environment where the speed limit of the road under present run and the road 
under present run are one-way traffic, or it is DO NOT ENTER. Each with the real situation of 
the geography environment where the current position of vehicles is near marine, or it is in a 
mountain receives VICS information (information from the broadcast terminal of VICS) by the 
communication device 17, or detects it based on the information (current position and map data) 
from navigation equipment 9. And the real situation in the road state of the road under present 
run having frozen or being asy to slide among "environment" of the circumf rence of v hides 
is detected based on the information from other control units which are controlling the brake 
gear. 

[0090] Moreover, each of the real situation of the weathers (b ing fine cloudiness, a light rain, 
rain, heavy rain, snow, thunder, a typhoon, tc.) of a pres nt location and the destination and th 
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real situation of the traffic situation of th road under pr s nt run b ing congested, or having 
become empty is det cted by rec iving VICS information by the communication device 1 7 among 
"the situations outside a vehicle." In addition, it is also detectable from the signal of the raindrop 

. sensor of the various sensors 1 9 that the weather of a its present location rains. And the signal 
and camera from the ultrasonic sensor of the various sensors 19 detect the real situation of 
vehicles circumference situations, such as xistence of flattery vehicles, and existence of 

* precedence vehicles, among "the situations outside a vehicle." 

[0091] On the other hand, the signal from the temperature sensor of the various sensors 19 
detects the real situation of the degree of room air temperature among "in-the-car situations." 
Moreover, the signal from the pressure sensor which detects the pressure which joins the 
bearing surface of a sheet detects the real situation of the entrainment state of the number of 
crews of vehicles (one person, two persons, three persons or more) among "in-the-car 
situations." 

[0092] Among "in-the-car situations", and operational status (a run by the congested passage, a 
comfortable run, those with oscillating, etc), An entrainment state (detailed content what man is 
sitting on the family companion and which seat). Or called it further the move purposes (a drive 
with a family, a drive with a friend, date with a sweetheart, etc.). About a real situation 
automatically undetectable using the information from navigation equipment 9, a communication 
device 1 7, the various sensors 1 9, other control units, etc. It detects because I ask by the 
message displayed on utterance and display 1 1 from a loudspeaker 7 to a user and have you 
teach by voice or key input from a user. 

[0093] Next, the system control section 21 performs processing for presuming the present 
demand of a user and a state in S210. The dialog data used for operating a device M3 out of a 
dialog database by processing of S210 here by processing of the last time of S270 and S280 
mentioned later are read. The contents described by both the items of "the presumed demand" 
of dialog data and "a presumed related demand" which were read it memorizes to the above- 
mentioned buffer area as a demand presumed that the user has now, and the contents further 
described by the item of the "presumed state" of the dialog data which carried out [ above- 
mentioned ] reading appearance are memorized to the above-mentioned buffer area as a state 
presumed that the user has become now 

[0094] For this reason, when processing of S210 is finished, the present users user profile 
(personal information), the keyword (however, silent or the contents of a no response is also 
included) which the user uttered, the contents showing the real situation that the user is placed, 
and the contents which presumed the demand of a user and the state will be memorized by the 
above-mentioned buffer area in FRAM. 

[0095] Then, in S220 continuing, the system control section 21 accesses a dialog database, and 
r^eads each set talk data. The contents described by each item of a "season", "a time zone or 
time", the "destination", a "present location", "environment", "the situation outside a vehicle", 
a "in-the-car situation", "a demand", a "state", "personal information", and "user utterance" 
about each set talk data. Matching with the contents memorized by the above-mentioned buffer 
area is investigated. 

[0096] The content the user specifically presumed matching with the keyword which actually 
spoke, and the keyword described by the item of "user utterance" of dialog data, and the 
demand of a user to be, The content which presumed matching with the content described by 
the item of "a demand" of dialog data, and a user s condition. Each content showing the real 
situation that matching with the content described by the item of the "state" of dialog data and 
the user are placed. Matching with the content described by each item of a "season", "the time 
zone or time" of dialog data, the "destination", a "present location", "environment", "the 
situation outside a vehicle", and a "in-the-car situation", and the present user s user profile. It 
investigates about each of matching ** with the content described by the item of the "personal 
information" on dialog data. 

[0097] Moreover, especially in these S220. the dialog data with which the content is d scribed by 
the item of "a demand" and "user utterance" are preferentially read among the dialog data in a 
dialog database. And as processing for investigating matching, it gives [ predetermined value / 
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every / (for example, one point) ] about each above-m ntioned it m of th read dialog data to 
the content and match which are memorized by the above-mentioned buffer area, and let the 
sum total mark be an evaluation value showing the degree of matching. However, you may 
. change mark about the specific item of each item of dialog data. 

[0098] And by processing of S220, th line number (namely, number of Line L shown in drawin g 4 
' drawing 8 ) is further memoriz d about N dialog data (for xample, eight pieces) sequentially 
from what has the computed largest evaluation value among each set talk data to a different 
specific field from the above-mentioned buffer area beforehand set up in RAM. 
[0099] And the greatest evaluation value computed by the above S220 in S230 continuing (that 
is, among N dialog data with which the line number was memorized to the above-mentioned 
specific field) If the evaluation value of the dialog data whose computed evaluation value is the 
maximum judges whether it is larger than the threshold set up beforehand and is not larger than 
the threshold It Judges that the contents (a user's utterance keyword or the content of a real 
situation) which should be detected by processing of SI 90 or S200 mentioned above are 
insufficient, and shifts to S240. 

[0100] And in these S240, the utterance which asks a user the content of detection which run 
short is outputted from a loudspeaker 7, and it returns to SI 80 after that. Then, although 
processing of S180-S220 will be perFormed again, when an inquiry to the user by processing of 
S240 is performed in this way, by S220, an evaluation value is calculated by the above- 
mentioned specific field only about N dialog data with which the line number was memorized. 
[0101] Moreover, when it judges with the greatest evaluation value computed by the above S220 
by the above S230 being larger than a threshold, it progresses to S250. In these S250. when it 
judges whether there are two or more dialog data whose computed evaluation values are the 
maximum to the above-mentioned specific field and more than one are in it about it among N 
dialog data with which the line number was memorized, it judges that it is necessary to narrow 
down one dialog data from two or more of the dialog data, and shifts to S260. 
[0102] And in these S260, the utterance which asks a user the content for narrowing down one 
dialog data from two or more above-mentioned dialog data is outputted from a loudspeaker 7. 
and it returns to SI 80 after that. Then, although processing of S180-S220 will be again 
performed also in this case, when an inquiry to the user by processing of S260 is performed in 
this way. by S220, an evaluation value is calculated by the above-mentioned specific field only 
about N dialog data with which the line number was memorized. 

[0103] On the other hand, when a negative judging is carried out by the above S250 (i.e.. when 
the number of the dialog data whose evaluation values are the maximum among N dialog data 
with which the line number was memorized to the above-mentioned specific field is one) It 
progresses to S270, the dialog data with which the evaluation value became the maximum are 
read, and the contents described by the item of "activity" of the dialog data are set up in RAM 
as activity of a device M3. And a device M3 is operated according to the activity set up by the 
above S270 in S280 continuing. 

[0104] That is, among each set talk data which constitute a dialog database from processing of 
S220-S280 Contents a "season", "a time zone or time", the "destination", a "present location", 
"environment", "the situation outside a vehicle", a "in-the-car situation", "a demand", a 
"state", "personal information", and the contents described by each item of "user utterance" 
are remembered to be by the above-mentioned bufFer area (the real situation that the user is 
placed) The contents to express, the contents which presumed the demand of a user and th 
state, the present user s user profile. And the dialog data which suited mo$t are searched and 
chosen as the keyword which the user uttered, and it is made to operate the devices M3 
including a loudspeaker 7 according to the contents described by "activity" of the selected 
dialog data. 

[0105] And it judges whether after that, it progressed to S290 and the dialog with a user was 
completed. In addition, in this judgment, wh n "it being noisy" from a user and th utteranc 
keyword of "good-bye" are inputted, it judges with the dialog having b en completed, for 
example. And although it returns to SI 40 when it judges with th dialog not b ing completed, 
when it judges with the dialog having been completed, proc ssing of th drawing 3 cone m d is 
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nded. 

[01 06] Next, an example is given and explained about an op ration of th above control units 1 . 
First, if a user utters keywords, such as a "m al" and "boiled rice", when v hides are running 

. the ordinary road, the dialog data of the line L9 illustrat d to drawing 5 will be chos n by 

processing of S220-S280, and the cont nts described by the item of "activity" of the dialog data 
(L9) will be set up as activity of a device M3. A nearby restaurant is searched by th CD-ROM 

* drive or communication device 1 7 of navigation equipment 9 from a its present location. 
Consequently, is it "meal from a loudspeaker 7? this — if it becomes closely, there is a store of 
the <a>, <b>, <c>, etc. affair <X1> Where does it eat? The agent utterance " is outputted. 
[0107] On the other hand, line L10 which will be illustrated to drawing 5 by processing of S220- 
S280 if a user utters keywords, such as a "meal" and "boiled rice", when vehicles are running 
the highway Dialog data are chosen and the contents described by the item of "activity" of the 
dialog data (L10) are set up as activity of a device M3. Agent utterance that consequently, it is a 
part for after <X3> if two near parking areas are searched by the CD-ROM drive or 
communication device 1 7 of navigation equipment 9 from a their present location and it is an 
after «e> parking area from a loudspeaker 7 to "<d> parking area" is outputted. [ of a part for 
X2 > and a degree ] 

[0108] Thus, in the control unit 1 of this operation gestalt the activity of a device M3 is 
changeable according to the actual situation that not only a user s utterance keyword inputted 
through a microphone 5 and the voice input section 25 but the user is placed. Therefore, even if 
a user s content of utterance is the same, according to the situation that the user is placed, 
activity of a device M3 can be made the optimal and device operation (in the case of this 
example, it is information offer operation) based on the request of the user by the fewer input 
from a user can be realized. 

[0109] When vehicles are running the ordinary road of Aichi Prefecture and Kariya-shi and a user 
utters the three keywords "Okazaki", a "meal", and the "India food", on the other hand, by 
processing of S220-S280 Line L1 1 illustrated to drawing 5 Dialog data are chosen and the 
content described by the item of "activity" of the dialog data (L1 1) is set up as activity of a 
device M3. Agent utterance that consequently, the time of Restaurant f and Restaurant f of the 
India food in Aichi Prefecture and Okazaki-shi which can be reserved is searched by the 
communication device 1 7 from the Internet etc., and <f> can be reserved to a part for <X5 > at 
the time of a loudspeaker 7 to " <X4>" is outputted. In addition, the above-mentioned line L1 1 In 
dialog data, <Kariya> is described by the item of a "present location" by the processing of SI 50 
till then. 

[01 10] And it is the above-mentioned line L1 1 in this way. When dialog data are chosen By th 
following processing of S210, it is a line L1 1. The content (a meal, a picnic, a parking lot. a break, 
drink) described by both the items of "a presumed demand" of dialog data and "a presumed 
related demand" While the above-mentioned buffer area memorizes as a demand a user is 
presumed to be, it is a line L1 1 . The content (before [ hungry ]) described by the item of the 
"presumed state" of dialog data is memorized by the above-mentioned buffer area as a state 
where a user is presumed. 

[01 1 1] For this reason, the above-mentioned line L1 1 If especially a user does not answer after 
the agent utterance according to dialog data is performed Line LI 2 illustrated to drawing 5 by 
the following processing of S220-S280 Dialog data (Namely, the dialog data with which the 
"ordinary road" was described by the item of "environment" and the "meal" and the "parking 
lot" were described by the item of a "demand") are chosen, and the content described by the 
item of "activity" of the dialog data (LI 2) is set up as activity of a device M3. Consequently, the 
parking lot g near the above-mentioned restaurant f is searched by the communication devic 1 7 
from Vies information etc.. and agent utterance of "<g> being vacant as for a parking lot" from 
the loudspeaker 7 is outputted. In addition, th above-m ntioned line LI 2 In dialog data, <the 
restaurant f in Okazaki> and <Kariya> are described by each item of the "destination" and a 
"present location" by the last processing of SI 50, r spectively. 

[01 12] Furthermore, it is the above-mentioned line LI 2 in this way. When dialog data ar chosen 
By the following proc ssing of 8210, it is a line LI 2. While th cont nt (path guidance) describ d 
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by the item of "a presum d demand" of dialog data is memorized by the abov -mention d buff r 
area as a demand a user is presumed to be Line LI 2 The content (preparation of movement) 
described by the item of the "presumed state" of dialog data is memorized by the abov - 

. mentioned buffer area as a state where a user is presumed. 

[0113] For this reason, the above-mentioned line LI 2 If especially a user does not answer aft r 
the agent utterance according to dialog data is performed Line LI 3 illustrated to drawing 5 by 

* the following processing of S220-S280 Dialog data (Namely, the dialog data with which the 

"ordinary road" was described by the item of "environment" and "path guidance" was described 
by the item of a "demand") are chosen, and the content described by the item of "activity" of 
the dialog data (LI 3) is set up as activity of a device M3. Agent utterance of consequently, 
recommending you to go by <i> since the main passages h and i and the traffic congestion 
situation of Passages h and i for going to the destination (Aichi Prefecture and Okazaki-shi) from 
a present location (Aichi Prefecture and Kariya-shi) were searched by the communication device 
1 7 from Vies information etc. and " <h> is crowded from the loudspeaker 7 with the 
communication device" is outputted. In addition, the above-mentioned line LI 3 In dialog data, . 
<Okazaki> and <Kariya> are described by each item of the "destination" and a "present 
location" by the last processing of SI 50, respectively. 

[01 14] On the other hand, when the dialog data of a line L9 mentioned above are chosen By the 
following processing of S210, the contents (a meal, a parking lot, a break, drink) described by 
both the items of "a presumed demand" of the dialog data of a line L9 and "a presumed related 
demand" While the above-mentioned buffer area memorizes as a demand a user is presumed to 
be, the contents (hungry) described by the item of the "presumed state" of the dialog data of a 
line L9 are memorized by the above-mentioned buffer area as a state where a user is presumed. 
[01 15] for this reason — for example, if the user uttered the keyword "the place where 
somewhere is good" and has moreover got on by the family companion in that case, after the 
agent utterance according to the dialog data of the above-mentioned line L9 is performed Line 
LI 4 illustrated to drawing 6 by the following processing of S220-S280 Dialog data (Namely, an 
"ordinary road" is described by the item of "environment" and a "family companion" is 
described by the item of a "in-the-car situation".) A "meal" is described by the item of a 
"demand" and is described by the item of a "state." The dialog data with which "the 

place where somewhere is good" was described are chosen as the item of "user utterance", and 
the content described by the item of "activity" of the dialog data (LI 4) is set up as activity of a 
device M3. Consequently, from the Internet etc. to a present location, a nearby family restaurant 
is searched by the communication device 1 7, and the agent utterance "how it is at OO 
restaurant" is outputted from a loudspeaker 7 by it. 

[01 16] While people have ridden on in the car, when the temperature of the vehicle interior of a 
room is 30 degrees C or more and the demand of a user presumed by processing of S21 0 
moreover is not "air-conditioner operation needlessness", for example, moreover, by processing 
of S220-S280 Line L20 illustrated to drawing 7 Dialog data are chosen and the content 
described by the item of "activity" of the dialog data (L20) is set up as activity of a device M3. 
Consequently, loudspeaker 7 shell "Is it hot? Is air^conditioner setting temperature lowered? 
Agent utterance of the question " is outputted. 

[01 1 7] And it is the above-mentioned line L20 in this way. When dialog data are chosen By the 
following processing of S210, it is a line L20. While the content (air-conditioner setting 
temperature is lowered) described by the item of "a presumed demand" of dialog data is 
memorized by the above-mentioned buffer area as a demand a user is presumed to be Line L20 
The content (a hot throat is a dry) described by the item of the "presumed state" of dialog data 
is memorized by the above-mentioned buffer area as a state where a user is presumed. 
[01 18] For this reason, the above-mentioned line L20 That a user is in ", and ", and well 
[ "well" ] or the keyword of "lowering" is uttered, or it is a no response after the agent 
utteranc according to dialog data is performed by processing of S220-S280 Line L22 illustrated 
to drawing 8 Dialog data are chosen and the content described by the item of "activity" of th 
dialog data (L22) is s t up as activity of a device M3. Consequently, loudspeaker 7 shell "I 
understand. Air^conditioner setting temp rature is lowered. While the agent utt ranc " is 
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outputt it will operat so that air-conditioner quipm nt 13 may lower th t mp ratur of th 
vehicle interior of a room. 

[01 1 9] On the other hand, the above-mentioned line L20 If a user utt rs "no" and th keyword 
• of "not continuing [ "disagreeable" or / this ] not lowering" aft r the agent utterance according 
to dialog data is perform d, [ "lowering" ] Line L23 illustrated to drawing 8 by processing f 
S220-S280 Dialog data are chosen and the cent nt described by the item of "activity" of th 
' dialog data (L23) is set up as activity of a device M3. Consequently, while agent utterance of 
"carrying out with this" from a loudspeaker 7 is outputted, it will operate so that air^conditioner 
equipment 1 3 may maintain the temperature of the vehicle interior of a room. 
[0120] Moreover, line L21 which will be illustrated to drawing 7 by processing of S220-S280 if a 
user utters the keyword " * **» ** " and ''*aicaMc:|c3Mc3|c^ when the temperature of the vehicle 
interior of a room is 20 degrees C or more Dialog data are chosen and the content described by 
the item of "activity" of the dialog data (L21) is set up as activity of a device M3. consequently, 
the case where the dialog data of a line L20 mentioned above are chosen — the same — "from 
a loudspeaker 7 — hot — coming out — a shank Is air-conditioner setting temperature lowered? 
Agent utterance of the question " is outputted. 

[0121] And it is the above-mentioned line L21 in this way. When dialog data are chosen the 
following processing of S210 — line L21 The content (air-conditioner setting temperature is 
lowered — I want to drink some — I want to rest) described by both the items of "a presumed 
demand" of dialog data and "a presumed related demand" While the above-mentioned buffer 
area memorizes as a demand a user is presumed to be, it is a line L21. The content (a hot throat 
is a dry) described by the item of the "presumed state" of dialog data is memorized by the 
above-mentioned buffer area as a state where a user is presumed. 

[0122] For this reason, the above-mentioned line L21 If a user is in "and utters "and the 
keyword of "well" after the agent utterance according to dialog data is performed Line L22 
mentioned above by processing of S220-S280 Line L23 mentioned above by processing of S220- 
S280 when dialog data were chosen and the user uttered conversely "no" and the keyword of 
being "disagreeable" Dialog data will be chosen. 

[01 23] That is, in the control unit 1 of this operation gestalt, a demand of a user will be 
presumed by processing of S210 based on at least one of the actual utterance keyword from a 
user, a user s real situation, and the activity that actually operated the device M3. And the dialog 
data which have the demand presumed by processing of S210 as a content of description of the 
item of a "demand" are chosen by processing of S220-S280, and device operation is performed 
by it based on the activity described by the item of "activity" of the selected dialog data. In 
addition, it depends on the description state [ whether based on which content, a demand of a 
user is presumed by processing of S210 among the actual utterance keyword from a user, a 
user's real situation and the activity of a device M3 ] of the dialog data used for operating a 
device M3 by last processing of S280. 

[0124] Therefore, according to the control unit 1 of this operation gestalt, device operation (in 
the case of the above-mentioned example, information offer operation and air-conditioner 
equipment 13 operate) based more on the request of a user is realizable. When running the 
ordinary road by the family companion in the time zone from 9:00 to 21:00 and a user, for 
example, utters keywords, such as "shopping" and "shopping", next, by processing of S220- 
S280 Line LI 5 illustrated to drawing 6 Dialog data are chosen and the content described by the 
item of "activity" of the dialog data (LI 5) is set up as activity of a device M3. Consequently, the 
nearby shopping centers j and k are searched by the CD-ROM drive or communication device 1 7 
of navigation equipment 9 from a their present location, and agent utterance of "<j> and <k> 
being in near if it is shopping" from a loudspeaker 7 is outputted. 

[01 25] And it is the above-mentioned line LI 5 in this way. When dialog data are chosen By the 
following processing of S210, it is a line LI 5. While the content (shopping, parking lot) d scrib d 
by both the items of "a pr sumed d mand" of dialog data and "a presumed related demand" is 
memorized by the above-mentioned buff r area as a demand a user is presumed to be Line LI 5 
The content (preparation of movem nt) described by the it m of the "presumed stat " of dialog 
data is memorized by the above-mentioned buff r area as a state wh re a user is pr sumed. 
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[0126] for this reason, the keyword [ user ] "a usual place" after the ag nt utt ranc according 
to the dialog data of the above-m ntion d line LI 5 was perFormed — speaking — moreov r — 
the item (P-10: — for the purpose of shopping) of the user's user profile Line LI 6 which will be 
* illustrated to drawing 6 by the following proc ssing of 8220-8280 if the content describ d at the 
place which goes well is "A d partment store" Dialog data are chosen. 

[0127] Namely, "9:00 to 21:00" are described by the item of "a time zone or time." An "ordinary 
road" is described by the item of "environment" and a "family companion" is described by the 
item of a "in-the-car situation." "Shopping" is described by the item of a "demand" and 
"preparation of movement" is described by the item of a "state." The dialog data (LI 6) with 
which "it goes to A department store well" was described by the item of "personal information", 
and "the usual place" was described by the item of "user utterance" are chosen. The content 
described by the item of "activity" of the dialog data (LI 6) is set up as activity of a device M3. 
The target product of the bargain performed at A department store today is searched by the 
communication device 1 7 from the Internet etc. Consequently, is it "A department store froni a 
loudspeaker 7? The bargain of OO (for example, electrical machinery supply) is done today. The 
agent utterance " is outputted. in addition — the above — a line — L — 16 — a dialog — data 
— setting — " — an individual — information — " — " — activity — " — each — an item — it 
can set — [ — ] — inside — *3|c** — S — 1 30 — processing — present — a user — being 
peculiar — " — A ^ a department store — " — describing — having — jm^** . 
[0128] If the content with which a user utters the two keywords "C mountain" and "skiing" at 
the season of winter, and is moreover described to be by the item (P-8 : hobby) of the user s 
user profile on the other hand is "skiing" Line LI 7 illustrated to drawing 6 by processing of 
S220-S280 Dialog data are chosen and the content described by the item of "activity" of the 
dialog data (L17) is set up as activity of a device M3. Consequently, agent utterance of "starting 
the root guide to C mountain skiing area" from a loudspeaker 7 is outputted, and path guidance 
operation to C mountain skiing area from the present location by navigation equipment 9 is 
started. 

[0129] Moreover, while the content with which a user utters "golf" and two keywords of "being 
usual", and is moreover described to be by the item (P-8 : hobby) of the user's user profile, for 
example is "golf" if the content described by the item (P-9: — the place which goes by the 
purpose of a hobby well) of this user profile is "D golf course" Line LI 8 illustrated to drawing 6 
by processing of 8220-8280 Dialog data are chosen and the content described by the item of 
"activi-^" of the dialog data (LI 8) is set up as activity of a device M3. Consequently, is it "D golf 
course from a loudspeaker 7? Is reservation status investigated? The agent utterance " is 
outputted. in addition, the above-mentioned line LI 8 a dialog — data — setting — " — an 
individual — information — " — " — activity — " — each — an item — it can set — [ — ] — 
ipside — aMesMc — S — 1 30 — processing — present — a user — being peculiar — " — D — a 
golf course — " — describing — having — **** . 

[0130] Thus, in the control unit 1 of this operation gestalt, the user profile which is information 
peculiar to a user is set to one of the parameters at the time of choosing dialog data, and the 
activity of the device M3 according to the user's user profile is set up. Therefore, device 
operation adapted to the request peculiar to a user is realizable. 

[0131] And while a two or more man-minutes user profile is memorized by the user profile 
storage section 37, the present user's user profile is specified and it is made to change 
automatically the content (the content of description of the item of "personal information" and 
"activity") of a dialog database by processing of 81 10-8130 according to the specified user 
profile. And the dialog data which suit the user profile which carried out [ above-mentioned ] 
specification are chosen, and it is made to set up the activity of a device M3 according to th 
content described by the item of "activity" of the dialog data. 

[01 32] Therefore, even if which man of two or more persons the user profile was rem mber d to 
be by the user profile storage section 37 uses the control unit 1 cone med, he can change the 
activity of a device M3 for every man of the, and can realize d vice operation further bas d on 
the request p culiar to the user. N xt, line LI 9 which will be illustrated to drawing 7 by 
processing of S220-S280 if people have ridd n on in the car, the temperature of the vehici 
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interior of a room moreover rises and it b com s 40 degr es C or more Dialog data are chosen 
and the content described by the item of "activity" of the dialog data (LI 9) is set up as activity 
of a device M3. Consequently, the degree of "room air temperature is over 40 degre s C from 

* the loudspeaker 7. Air-conditioner setting temp rature is lowered. While the agent utterance " is 
outputted, it will operate so that air-conditioner equipment 1 3 may low r the temperature of the 
vehicle interior of a room. 

* [0133] That is, in the control unit 1 of this operation gestalt, dialog data are chosen only from 
the real situation of the user who detected, and the activity of a device M3 is set up. Therefore, 
when the situation that the user is placed turns into a specific situation, irrespective of other 
factors, such as a user's utterance, a device M3 can be operated In predetermined activity, and 
it is advantageous. 

[01 34] As explained in full detail above, according to the control unit 1 of this operation gestalt, 
according to a user s situation and a demand, operation of devices, such as the content of 
utterance and air-conditioner equipment 1 3, can be made the optimal, and, moreover, a user can 
be exactly provided with useful information. Moreover, the dialog which has familiarity with a user 
can be performed and a sense of closeness can also be given to a user 

[0135] In addition, with this operation gestalt, processing of S180 and SI 90 is equivalent to the 
input means Ml, processing of SI 40, SI 50, and S200 is equivalent to the situation detection 
means M5, processing of S220-S270 is equivalent to the setting means M9, and processing of 
S280 is equivalent to the appliance control means Ml 1. And processing of 8210 is equivalent to 
the demand presumption means Ml 3, processing of S1 10 and SI 20 is equivalent to the 
discernment means M19, and processing of SI 30 is equivalent to the change means Ml 7. 
[01 36] Moreover, with this operation form, the dialog data-storage section 35 is equivalent to the 
data-storage means M7 for an activity setup, and the user profile storage section 37 is 
equivalent to the individual information-storage means Ml 5. And it is lines L9-L1 1, LI 5, and L21 
among the dialog data illustrated to drawing 4 - drawin g 8 . Dialog data It is equivalent to the 
data D1 for an activity setup, and is line LI 2 -LI 4, L20, L22, and L23. Dialog data It is equivalent 
to the 2nd data D2 for an activity setup, and is line L16 -LI 8. Dialog data are equivalent to the 
3rd data D3 for an activity setup, and it is a line LI 9. Dialog data are equivalent to the 4th data 
D4 for an activity setup. 

[0137] Next, other examples are explained. First, in the control unit 1 of this operation form, the 
real situation of the weather is grasped with the instruction from VICS information and the user 
by the dialog, or the signal from a sensor (S200). In addition, what is necessary is to perform 
agent utterance of the inquiry "whether it has cleared up now", and just to get replies, such as 
"that is right" and "disagreeableness and raining", from a user, in receiving instruction from a 
user. 

[01 38] Therefore, when the weather is fine, for example, the agent utterance "whether it is WX 
best to golf today" can be performed, and the dialog which has familiarity to a user can be 
carried out. moreover — the case where the agent utterance "whether the now of the autumnal 
leaves of Arashiyama is best time to see" is performed, or a time zone is daytime when a season 
is autumn since time, the present four seasons, and a present time zone are grasped in the 
control unit 1 of this operation form based on the data of the clock built in self (SI 40) for 
example, — " — is it the time of lunch boiled rice, soon? The next service area is 1 0km beyond. 
The agent utterance " can be performed and the dialog which has familiarity to a user can be 
carried out 

[0139] on the other hand — ; a control unit — one — grasping — in the ce^r — a situation — 
inside — entrainment — a state — it is — which — a seat — what — people — sitting down - 

- **** — or — ** — saying — being detailed — the contents — the following — [ — ] — insid 

— like — it can describe . 

[SEAT.ID ,PSTYPE,PATYPE,PTYPE ,PROnLEJD] 

In addition, SEATJD It is data showing the classification of a s at (sheet), and SEATJD =0 
shows a driver s seat SEATJD =1 shows a passenger seat SEATJD =2 show the backseat right 
SEATJD =3 show the cent r of a backseat and SEATJD =4 show the backseat I ft 
[0140] Mor over, PSTYPE is data showing crew's sex, PSTYPE=0 shows xcept human b ings. 
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such as a load and an animal, PSTYPE=1 shows a nnale, and PSTYPE=2 show a woman. 

Furthermore. PATYPE is data showing the classification of crew s age, PATYPE=0 shows an 

infant, PATYPE=1 shows a small child. PATYPE=2 show a schoolchild, PATYPE=3 show a junior 
, high school student, PATYPE=4 show a high school student, PATYPE=5 show a young man, 

PAPr'PE=6 show the man in the street, and PATYPE=7 show an old man. 

[0141] And PTYPE Are data showing crew's type and PTYPE =0 shows an operator (driv r). 
• PTYPE =1 shows an operator s spouse and PTYPE =2 show an operator's child. PTYPE =3 show 

an operator s parents, PTYPE =4 show other families of an operator. PTYPE =5 show intimate 

persons other than a family, PTYPE =6 show an operator s acquaintance, and PTYPE =7 show 

other men. 

[0142] And PROFILEJD is data showing crew's name or name further. Therefore, for example, in 
[SEATJD. PSTYPE, PATYPE, PTYPE, and PROFILEJD] = [2. 1, 2, 2. and OO Tare], it means that 
00 Taro who is a boy schoolchild and is an operator's child is sitting on the backseat right 
[0143] And when a control unit 1 grasps such a situation, agent utterance like for example, 
following (1) - (3) and operation corresponding to it can be performed. 

(1) The time of vehicles stopping from a run state, "it stopped. When you come out outside Taro 
and a vehicle, please check back and open a door. Agent utterance of the warning " is 
performed. 

[0144] (2) The time of vehicles departing from a stop state, "depart The backseat right covers a 
child protector. While performing the agent utterance the child protector of a posterior part 
right-hand side door is made to be covered over other control units. 

(3) The time of a user uttering the two keywords "Taro" and a "TV phone", "introduce the 
camera of a TV phone to Tare. Whom is the partner who talks? After performing agent utterance 
of the inquiry ", other control units are made to turn and acfjust the position posture and focus 
of a camera of a TV phone to Taro. 

[0145] moreover, for example [SEATJD. PSTYPE, PATYPE, PTYPE. and PROFILEJD] = [2, 2, 6, 
1, and OO Hanako] [SEATJD. PSTYPE, PATYPE, PTYPE, and PRORLEJD] =[2, 2. 0. and 2. O 
Mean holding OO pod the Hanako of whose is moreover a female infant in her child by OO 
Hanako who is an operator's wife sitting on the backseat right in O pod or]. 

[0146] And when a control unit 1 grasps such a situation, according to the operation situation of 
vehicles, it is a sharp cur/e rightward from "300-meter beyond. Please hold Hanako. a pod, or 
****** firmly. Agent utterance of the warning " can be performed. 

[0147] On the other hand, the 12-bit data (it is hereafter described as AUDIO.ENV) explained 
below can describe the content of the audio environment of the in-the-car situations which a 
control unit 1 grasps again. Namely. AUDIO.ENV When a least significant bit is made into the 0th 
bit. For example, the 0th the ON/the bit of the OFF of a cassette are shown, and the 1st the 
ON/the bit of the OFF of a CD player are shown. ON/OFF of MD player are shown, and a triplet 
eye shows the 2nd the ON/the bit of the OFF of DVD. It is shown whether the 4th bit of the FM 
broadcasting of radio is received, and it is shown whether the 5th bit of the AM broadcast of 
radio is received. The 7th the ON/the bit of the OFF of television are shown, the 8th the 
ON/the bit of the OFF of video are shown, the 9th the ON/the bit of the OFF of a telephone are 
shown [ it is shown whether the 6th bit of the broadcast of a road traffic center is received, ], 
and the 10th bit and the 1 1th bit are bits of un-using it or a reserve. 

[0148] Therefore, for example, in AUDIO_ENV = [1000 0001 0100], it means that a cassette, 
television, and the telephone are turned on [ them ]. in addition — this example — □ — the bit 
by the side of the inner leftmost is the 0th bit And when a control unit 1 grasps such a situation, 
the following agent utterance and operation corresponding to it can be performed, for example. 
[0149] First the time of a cassette, television, and the telephone being turned on [ them ] as 
mentioned above, "he is on the telephone. Please lower the volume of a cassette and television. 
The agent utteranc " is perform d. Furthermore, when it detected that vehici s went into the 
tunnel of a highway, it went into "tunnel. I tell broadcast of a road traffic center. Aft r 
performing the agent utterance ". the volume of other audios (th y are a cassette and t levision 
in this case) is lowered. In addition, this b comes AUDIO_ENV = [1000 001 1 0100]. 
[01 50] And aft r performing the agent utteranc of "Making a headlight turn on", a h adiight is 
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made to turn on, when it can come, simultan ously the headlight of v hid s is not turned on. As 
mentioned above, this invention cannot be overemphasized by that it is not limited to the above-- 
mentioned operation gestalt, and various gestalten can be taken although 1 operation g stalt of 

> this invention was explained. 

[0151] For example, although the control unit 1 of the above-mentioned operation form was 
carri d in vehicles, it can apply this invention indoors similarly to the equipment which controls 

' various built-in devices. Moreover, although the control unit 1 of the above-mentioned operation 
form inputted a user's utterance keyword, you may make it input the information by a user's key 
stroke as information in which the intention of a user was reflected. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damaees caused by the us of this translation. 

1 . This document has be n translated by computer.So the translation may not reflect the original 
' precisely. 

2. **5|c* shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL FIELD 

[The technical field to which invention belongs] this invention relates to the control unit which 
operates predetermined devices, such as a device for information retrieval, and a device for 
voice outputs, according to the input in which the intention of users, such as utterance, a key 
stroke input, etc. of a user, was reflected. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is n t responsible for any 
damag s caused by th use of this translation. 

1 . This document has been translated by computerSo the translation nnay not reflect the original 
precisely. 

2. **5Mc shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



PRIOR ART 

[Description of the Prior Art] That to which a user performs operation corresponding to the 
voice command by uttering the language beforehand defined as a voice command as navigation 
equipment for recent years, for example, automobiles, is put in practical use. 
[0003] For example, when a user utters the voice command a "present location", while the 
control section which consists of a microcomputer which accomplishes the center of the 
equipment concerned makes devices for information retrieval, such as a CD-ROM drive, search 
the name of a place, an institution, etc. near a its present location with this kind of equipment, it 
is made to make the voice for guidance "it is near 00" output from the device for voice outputs 
which consists of a loudspeaker etc. based on the reference result. 
[0004] Moreover, when the name of a place is uttered, while the control section of the 
equipment concerned, for example, makes the device for information retrieval search the 
circumference map of the name of a place by which utterance was carried out [ above- 
mentioned ] after a user utters the voice command "map reference", it is made to display the 
circumference map of the name of a place by which utterance was carried out [ above- 
mentioned ] on the device for a display which consists of CRT etc. based on the reference 
result. 



[Translation done.] 
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* NOTICES * 

Japan Pat nt Office is not responsible for any 
damages caused by the use f this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
- precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



EFFECT OF THE INVENTION 



[A The means for solving a technical problem and an effect of the invention] The control unit of 
this invention according to claim 1 made in order to attain the above-mentioned purpose is 
equipped with an input means Ml to input the information in which the intention of a user to this 
user was reflected, and operates the predetermined device M3 according to the information 
(henceforth input) inputted by the input means Ml so that it may illustrate to drawin g 1 . 
[0009] In addition, various things, such as a device for communication by the device for 
information retrieval with which information is searched from a predetermined database as a 
device M3, the device for voice outputs which outputs voice, radio, or the cable, air-conditioning 
equipment, audio equipment, such as television and a tape recorder, devices for a display, such 
as CRT and liquid crystal, and a lighting device, can be considered. And you may be one, and two 
or more devices MS which the control unit concerned operates may reach, and the number of 
them may be [ two or more ]. 

[0010] Moreover, as information which the input means Ml inputs, various things, such as a 
keyword of the voice which the user uttered, and information by a user s key stroke or switch 
operation, can be considered. Furthermore, you may make it include no inputting (getting it 
blocked and a user not inputting information intentionally) as information which the input means 
M1 inputs. 

[0011] Especially the control unit of this invention is equipped with a situation detection means 
M5 to detect the situation that the user is placed, and the data-storage means M7 for an 
activity setup, and the data D1 for an activity setup for setting up the activity of a device MS . 
are memorized by the data-storage means M7 for an activity setup here from the information 
inputted by the input means M1, and the situation detected by the situation detection means M5. 

[0012] And if there is activity to which the setting means M9 searches the activity 
Corresponding to the information inputted by the input means Ml and the situation detected by 
the situation detection means M5 from the aforementioned data D1 for an activity setup, and 
corresponds, the activity will be set up as activity of the aforementioned device MS. Then, th 
appliance control means Ml 1 operates a device MS according to the activity set up by the 
aforementioned setting means M9. In addition, in this invention, the content of a do-nothing 
operation (it is got blocked and don't operate a device MS) is also included as activity of a device 
MS. 

[001 S] According to the control unit of such this invention, according to the situation that not 
only the input from a user inputted by the input means Ml but the user is placed, the activity of . 
a device MS is changeable. That is, even if the input from a user is the sanie, according to th 
situation that the user is placed, activity of a device MS can be made the optimal. Therefore, 
device operation adapted to the request of the user is realizable by the fewer input from a us r. 
[0014] The control unit according to claim 2 is added and equipped with the demand presumption 
means MIS to the control unit according to claim 1 so that it may illustrate to drawin g 1 . next, 
this demand presumption means M1S A demand of a user is presumed bas d on at I ast one of 
the information inputted by the input means Ml, the situation detected by the situation 
detection means M5, and the activity of th device MS by the appliance control means Ml 1. 
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[0015] And the 2nd data D2 for an activity s tup for setting up th activity of a device M3 is 
further memorized by the data-storage means M7 for an activity s tup from at least two or more 
items including the demand pr sumed by the demand presumption means Ml 3 among th 

. information inputted by the input means M1. the situation detected by the situation d tection 
means M5, and the demand presumed by the demand presumption means Ml 3. 
[0016] The setting means M9 and among the information inputted by the input means Ml, the 

' situation detected by the situation detection means M5, and the demand presumed by the 
demand presumption means Ml 3 If the activity corresponding to at least two or more items 
including the demand presumed by the demand presumption means M13 is searched from the 
data D2 for an activity setup of the above 2nd and there is corresponding activity, the activity 
will be set up as activity of a device M3. 

[0017] That is, a demand of a user is presumed based on at least one of the input from a user, 
the situation detected by the situation detection means M5, and the activity of the device M3 by 
the appliance control means M1 1, and it is made to set up the activity of a device M3 for a 
demand of the user who presumed as one of the parameters in a control unit according to claim 
2. 

[0018] Therefore, according to such a control unit according to claim 2, device operation based 
more on the request of a user is realizable. In addition, what is necessary is just to set up 
beforehand the data D1 for an activity setup, and the 2nd data D2 for an activity setup 
exclusively so that the activity from which the setting means M9 differs simultaneously from 
each data D1 and D2 may not be discovered. Moreover, when the priority of reference was 
prepared in each data D1 and D2, and the setting means M9 searches every one to the activity 
of each data D1 and D2 according to the priority and has the corresponding activity, you may 
make it set up the activity as activity of a device M3. 

[0019] Next, the control unit according to claim 3 is added and equipped with an individual 
information-storage means Ml 5 to memorize a users personal information, to the control unit 
according to claim 2 so that it may illustrate to drawin g 1 . Further and for the data-storage 
means M7 for an activity setup Among the information inputted by the input means Ml, the 
situation detected by the situation detection means M5, the demand presumed by the demand 
presumption means Ml 3, and the personal information memorized by the individual information- 
storage means Ml 5 From at least two or more items including the personal information 
memorized by the individual information-storage means Ml 5. the 3rd data D3 for an activity 
setup for setting up the activity of a device M3 is memorized. 

[0020] The setting means M9 and among the information inputted by the input means Ml, the 
situation detected by the situation detection means M5, the demand presumed by the demand 
presumption means Ml 3. and the personal information memorized by the individual information- 
storage means Ml 5 If the activity corresponding to at least two or more items including the . 
personal information memorized by the individual information-storage means Ml 5 is searched 
from the data D3 for an activity setup of the above 3rd and there is corresponding activity, the 
activity will be set up as activity of a device M3. 

[0021] According to such a control unit according to claim 3. by memorizing the personal 
information of the user who actually uses the equipment concerned for the individual 
information-storage means Ml 5. the users personal information is set to one of the paramet rs, 
and the activity of a device M3 will be set up. Therefore, according to this control unit, device 
operation adapted to the request peculiar to a user can be realized, and it is advantageous. 
[0022] In addition, what is necessary is just to set up beforehand the data D1 for an activity 
setup, the 2nd data D2 for an activity setup, and the 3rd data D3 for an activity setup 
exclusively so that the activity from which the setting means M9 differs simultaneously from 
each data D1. D2. and D3 may not be discovered. Moreover, when the priority of reference was 
prepared in each data D1. D2, and D3, and the setting means M9 searches every one to the 
activity of each data D1, D2, and D3 according to the priority and has the corresponding activity, 
you may make it set up the activity as activity of a device M3. 

[0023] Next, the control unit according to claim 4 is added and equipp d with the chang means 
Ml 7 to the control unit according to claim 3 so that it may illustrate to drawing 1 . And th 
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change means M17 changes the data D3 for an activity setup of the abov 3rd according to th 

personal information memorized by the individual information-storage means Ml 5. 

[0024] According to such a control unit according to claim 4, device op ration which actually 

. us s the equipment concerned and which could change the activity of a device M3 and was 
further based on the request peculiar to a user for every user is realizable. A control unit 
according to claim 5 is set to a control unit according to claim 4 so that it may illustrate to 

' drawing 1 . next, for the individual information-storage means M15 While two or more man- 
minutes personal information is memorized, it has a discernment means Ml 9 to specify the 
present user s personal information, out of the two or more man-minutes personal information 
memorized by the individual information-storage means Ml 5. 

[0025] And the change means M17 changes the data D3 for an activity setup of the above 3rd 
according to the personal information specified by the discernment means Ml 9. and in case the 
setting means M9 searches activity from the data D3 for an activity setup of the above 3rd, the 
personal information specified by the aforementioned discernment means M19 is used for it. 
[0026] According to this control unit according to claim 5. even if which man of two or more . 
persons personal information was remembered to be by the individual information-storage means 
Ml 5 uses the equipment concerned, he can acquire the effect by the control unit according to 
claim 4. Next, in the control unit according to claim 6, in the control unit according to claim 1 to 
5, the 4th data D4 for an activity setup for setting up the activity of a device M3 is memorized 
only from the situation detected by the situation detection means M5 by the data-storage 
means M7 for an activity setup so that it may illustrate to drawin g 1 . 
[0027] And if the setting means M9 searches the activity corresponding to the situation 
detected by the situation detection means M5 from the data D4 for an activity setup of the 
above 4th and has the corresponding activity, the activity will be set up as activity of a device 
M3. That is, in the control unit according to claim 6, the activity of a device M3 is made to be set 
up only from the situation detected by the situation detection means M5. 
[0028] When the situation that the user is placed turns into a specific situation according to 
such a control unit according to claim 6, irrespective of other factors, such as input from a user, 
a device M3 can be operated in predetermined activity, and it is advantageous. For example, 
when it has the device for voice outputs which outputs voice as a device M3, warning with voice 
etc. can be performed to a user in a specific situation. 

[0029] In addition, what is necessary is just to set up beforehand the 4th data D4 for an activity 
setup, and other data for an activity setup (D1, D2. D3) exclusively so that the activity from 
which the setting means M9 differs simultaneously from each data may not be discovered. 
Moreover, you may prepare the priority of reference in the 4th data D4 for an activity setup, and 
other data for an activity setup (D1, D2. D3). 

[0030] Next, in a control unit according to claim 7, the input means Ml inputs the keyword which 
the user uttered in a control unit according to claim 1 to 6 as the aforementioned information 
(information in which the intention of a user was reflected). And a device M3 consists of a device 
for voice outputs for outputting voice, and other devices. 

[0031] According to such a control unit according to claim 7, the appliance control equipment of 
the interactive mode which operates other devices other than the device for voice outputs can 
be easily constituted according to the content of a setting of each data D1-D4 for an activity 
setup which the data-storage means M7 for an activity setup is made to memorize, conversing 
with a user with voice. It becomes information offer equipment of the interactive mode which can 
offer exactly the information which the device for information retrieval with which information is 
searched from a predetermined database, then a user expect a device besides the above 
especially. 
[0032] 

[Embodiments of the Invention] Hereafter, the operation form of this invention is explain d using 
a drawing. Drawin g 2 is a block diagram showing the composition of th control unit 1 of an 
operation form first. In addition, the control unit 1 of this operation form controls various devic s 
carried in the vehicles, being carried in an automobile (v hides) and having a dialog with the 
or w (mainly operator) and voice of vehici s as a user. 
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[0033] As shown in drawing 2 . the control unit 1 of this op rati n gestalt The input unit 3 for a 
user inputting various kinds of instructions, data, etc. by external operation. The microphon 5 
for inputting voice, and the loudspeaker 7 for outputting voice, Th navigation equipment 9 of the 
» common knowledge which performs detection, path guidance, etc. of the current position (its 
present location) of vehici s. The display 1 1 for displaying a picture, and the air^conditioner 
equipment 13 which controls air-conditioning in the car. The audio equipment 15 which consists 
of a cassette tape recorder, CD (compact disk) player, MD (mini disc) player, radio, television, 
etc.. The broadcast terminal of well-known VICS (Vehicle Information and Communication 
System), The communication device 1 7 which performs data communication by radio between 
the Internet broadcast terminals which are connection windows with the Internet, It connects 
with the various sensors 1 9 for detecting vehicles operational status, such as the vehicle spe d 
and an acceleration-and-deceleration state, the temperature of vehicles inside and outside, the 
existence of a raindrop, etc., and other control units (illustration ellipsis) which control the door 
lock of vehicles, a windowpane (power window), an engine, a brake gear, etc. 
[0034] In addition, navigation equipment 9 is equipped with the operation key for the CD-ROM 
drive for reading data and a user inputting instructions etc. from CD-ROM which memorized data 
for path guidance, such as GPS equipment of the common knowledge for detecting the current 
position of vehicles, and map data, name of a place data, institution name data, and its CD-ROM. 
And if the instructions which direct the path guidance to the destination and the destination 
through an operation key from a user are inputted, navigation equipment 9 will display a road map 
including the optimal path for resulting to the current position and the destination of vehicles on 
display 1 1 , and will perform path guidance. Moreover, if the road map for path guidance is not 
only displayed, but various pictures, such as a menu for information retrieval, are displayed on 
display 1 1 and audio equipment 1 5 is further set as the mode of television with navigation 
equipment 9, the receiving picture of television received by the television tuner with which the 
audio equipment 15 was equipped will be displayed on it. 

[0035] And the system control section 21 constituted centering on the microcomputer with 
which a control unit 1 consists of CPU, a ROM, RAM, etc.. The interface 23 which inputs the 
instructions and data from an input unit 3 into the system control section 21 (I/F), The voice 
input section 25 which changes into digital data the sound signal inputted from the microphone 5, 
and is inputted into the system control section 21, The speech synthesis section 27 to which 
the text data outputted from the system control section 21 is changed into the sound signal of 
an analog, it outputs to a loudspeaker 7, and singing of the loudspeaker 7 is carried out. It has 
the above-mentioned navigation equipment 9, display 11, air-conditioner equipment 13, audio 
equipment 1 5, a communication device 1 7, the various sensors 1 9, and the appliance control 
interface (appliance control I/F) 29 that connects other control units and system control 
sections 21 possible [ data communication ]. 

[0036] Moreover, the control unit 1 is equipped with the Internet address database 31 which 
memorizes the address (Internet address) of the Internet, and the reference control section 33 
in order to search and acquire the information on desired from the Internet by the 
communication device 17. And when the system control section 21 outputs the reference 
keyword showing the content of reference (contents) to the reference control section 33, the 
reference control section 33 operates a communication device 1 7 through appliance control 
I/F29, searches the information corresponding to the above-mentioned reference keyword from 
the Internet broadcast terminal, and makes the reference result input into the system control 
section 21. Moreover, in the Internet address database 31, the Internet address used by the 
reference control section 33 in the past is memorized by the instructions from the system 
control section 21, and the reference control section 33 will reuse the Internet address in the 
Internet address database 31, if the same reference keyword as the reference k yword inputted 
in the past is received from the system control section 21. 

[0037] In addition, with this operation gestalt, it is equivalent to the device M3, and h reafter, a 
loudspeaker 7, navigation equipment 9, the CD-ROM drive (illustration ellipsis) with which the 
navigation equipm nt 9 was quipp d, display 1 1 , air-condition r quipm nt 1 3, audio quipment 
1 5, a communication devic 1 7, and other control units (illustration ellipsis) name these 
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generically, and call it a device M3. Moreover, among these devic s M3, a loudsp aker 7 is 
equivalent to the device for voice outputs, and except [ it ] is quivalent to other d vices. 
[0038] And the utterance furth r outputted to a control unit 1 from a loudspeaker 7 As a means 

^ to memorize the data for setting up the content (namely, activity of a loudspeaker 7) of (also 
calling it agent utterance her after), and the activity of a device besides the above of those 
other than loudspeaker 7 It has the dialog data-storage section 35 which m morizes a dialog 

' database, and the user profile storage section 37 which memorizes a user's two or more man- 
minutes personal information (henceforth a user profile). In addition, the Internet address 
database 31 mentioned above with this dialog data-storage section 35 and the user profile 
storage section 37 is constituted by the non-volatile memory in which read-out and the writing 
of data are possible. 

[0039] Here, the dialog database memorized by the dialog data-storage section 35 and the user 

profile memorized by the user profile storage section 37 are explained. First, the information that 

the user profile as personal information memorized by the user profile storage section 37 is 

peculiar to a user about each item, such as the following - (P-1) (P-1 1), is described. 

[0040] (P-1): Classifications of the man (general, the president, a young man. sex. etc.). 

(P-2): Other identification information other than a name or the name for discriminating the man 

further (a password, identification number, etc.). 

(P-3): Birth date (birthday). 

[0041] (P-4): Hometown. 

(P-5): Address. 

(P-6): Occupation. 

(P-7): Executive. 

[0042] (P-8): Hobby. 

(P-9): The place which goes by the purpose of a hobby well. 

(p-10): The place which goes by the purpose of shopping well. 

(P-1 1): Family composition, a family's name, and a family's birth date. 

[0043] In addition, this user profile is memorized by the user profile storage section 37 by write- 
in operation of the system control section 21, when a user operates an input unit 3 and inputs 
the contents of each above-mentioned item. Next, the dialog database memorized by the dialog 
data-storage section 35 has the data structure of a tabular format for the example, as shown in 
drawing 4 - drawing 8 . And it sets to drawing 4 - drawing 8 , and they are each lateral lines LI - 
L23. It is 1 set of dialog data, and the dialog database consists of plurality of such dialog data. In 
addition, at d rawin g 4 - drawin g 8 , they are each lines LI -L23. It is continued and expressed to 
two steps. 

[0044] Namely, each set talk data which constitute a dialog database The item of a classification 
of the dialog data, and two or more items showing the situation that the user is placed (with this 
operation form) The environment of a season, a time zone or time, the destination, a its present 
location, and the circumference of vehicles, the situation outside a vehicle, and an in-the-car 
situation. The item of a demand of a user, the item of a user's condition, and the item of a user's 
personal information, The item of the utterance (henceforth user utterance) of a user inputted 
through a microphone 5 and the voice input section 25, The item of the activity at the time of 
the control unit 1 concerned operating a device M3 (the contents of agent utterance, and 
activity of other devices other than loudspeaker 7), It has the data area for describing 
corresponding contents about each of the item of the presumed demand which is a demand of a 
user presumed, the item of the presumed state which is in a user s state presumed, and the item 
of the presumed related demand which are other demands of a user presumed. And each set talk 
data describe the contents corresponding to the data area of each above-mentioned item. In 
addition, description means that the data showing the contents corresponding to the data area 
secured beforehand are set. 

[0045] Here, each item of such a dialog database is explained concretely. 

(C-1): The contents as which the dialog data xpresses whether it is a thing about what subj ct 
in a dialog with a user are b forehand describ d by the item of a classification "a classification", 
and th contents showing the classification of the agent utteranc described by the it m of 
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"activity" mentioned especially later are described. 

[0046] although there are a greeting, appreciation, a family, am al, a parking lot. path guidance, 

reference, shopping, a hobby, device operation, etc. and illustration is not further carrt d out as 
^ contents described by and this item of "classification", for example so that it may illustrate to 

drawing 4 - drawin g 8 — in addition, introduction, a sport, and the destination — it asks a 

question and checks, and it suits and ^mcsm^. a halt, an end, etc. ar 
" [0047] (C-2): The contents which subdivided further the four seasonses, such as any, early 

summer, midsummer, etc. of the four seasons, such as spring, summer, autumn, and winter, are 

beforehand described by the seasonal "a season" item. 

(C-3): The contents of the concrete time zone called daytime, night, early morning, midnight, etc. 
and when to when or the detailed time of what minute is described when by the item of a time 
zone or time "a time zone or time" on what [, what / month / what ] in the morning. 
[0048] And the item of this "time zone or time" has that the contents are beforehand described 
to be. and the thing the system control section 21 describes the contents to be serially. For . 
example, the line LI 5 illustrated as the lines L1-L3 and the dialog data of L7 which are 
illustrated to drawing 4 to drawing 6 and LI 6 In dialog data, the contents showing a time zone 
are beforehand described by the item of "a time zone or time." moreover, line L1 1 illustrated to 
drawing 5 a dialog — data — setting — " — a time zone — or — time — " — an item — it can 
set — < — > — inside — *5|c5|c* — system control — the section — 21 — present — time — 
serially — updating — having — describing — having . 

[0049] (C-4): The destination which a user means is described by the system control section 21 
by the item of the destination "the destination." In addition, the system control section 21 reads 
the destination set up by the user from navigation equipment 9, or acquires the contents which 
should be described in the item of the "destination" according to the contents of a dialog with 
the user till then. 

[0050] And the item of this "destination" has some which are not described to be that the 
contents are described to be. the line LI 2 illustrated to drawing 5 and LI 3 a dialog — data — 
setting — " — the destination — " — an item — it can set — < — > — inside — **** — 
system control — the section — 21 — till then — a user — a dialog — the contents — having 
responded — the destination — describing — having . [ for example, ] Moreover, the above- 
mentioned line LI 2 illustrated to drawing 4 - drawing 8 and LI 3 The contents are described by 
the item of the "destination" in the dialog data of an except. 

[0051] (C-5): The present location of vehicles is described by the system control section 21 by 
the item of a present location "a present location." In addition, the system control section 21 
reads the present location of vehicles from navigation equipment 9. and acquires the contents 
which should be described in the item of a "present location." 

[0052] And the item of this "present location" has some which are not described to be that the 
contents are described to be like the item of the "destination." line L1 1 -LI 3 [ for example, ] 
illustrated to drawing 5 a dialog — data — setting — " — a present location — " — an item — 
it can set — < — > — inside — **** — system control — the section — 21 — vehicles — a 
present location — describing — having . Moreover, above-mentioned line L1 1 -LI 3 illustrated 
to drawing 4 - drawing 8 The contents are described by the item of a "present location" in th 
dialog data of an except 

[0053] (C-6): The contents showing the environment of the circumference of vehicles are 
beforehand described by the environmental "environment" item: Specifically, the contents 
showing road environment, the contents (it is easy to slide on a road surface freeze and a road 
surface) showing a road (highway, ordinary-road, national highway, prefectural road, etc.) state, 
the contents (a speed limit, one-way traffic, DO NOT ENTER, etc.) showing traffic environment, 
and the contents (the inside of the mountain where the sea is near, and a town, before a station, 
etc.) showing geography environment are described beforehand. 

[0054] (C-7): The contents showing the situation outside a vehicle are beforehand described by 
the item of the situation outside a v hide "the situation outside a vehicle." The contents which 
specifically express the weath r of a their present location (being fine cloudiness, a light rain, 
rain, heavy rain, snow, thunder, a typhoon, etc.), The contents (b ing fine cloudiness, a light rain, 
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rain, heavy rain, snow, thunder, a typhoon, etc.) showing the w ath r of the d stination. the 
contents (traffic congestion, the occurrence of accident which it is cong st d and has become 
empty a little) showing a traffic situation, and the contents (those with passing vehicles, those 

, with flattery vehicles, those with preced nee vehicles, etc.) showing a vehicles circumf rence 
situation are described befor hand. In addition, as contents showing a vehicles circumf rence 
situation, the classification (a truck, a passenger car, motorbike, etc.) of passing vehicles or 

* flattery vehicles can also be added and described. 

[0055] (C-8): The contents showing a situation in the car are beforehand described by the item 
of an in-the-car situation "an in-the-car situation." The contents which specifically express 
operational status (a run by the congested road, a comfortable run. those with oscillating, spe d 
over, etc.), the contents (one person and two persons — many (three or more persons) — a 
family companion — or further) showing an entrainment state Contents showing the degree of 
vehicle room air temperature, such as detailed contents what man is sitting on which seat, the 
contents (a drive, with a family, a drive with a friend, date with a sweetheart, etc.) showing the 
move purpose, the contents showing audio environment, etc. are described beforehand, 
[0056] (C-9): The contents showing the demand considered that a user has in the item of a 
demand "a demand" are described beforehand. Specifically, the contents of air^conditioner 
operation needlessness etc. which lower a meal, a drink, shopping, a drive, a break, play, a park, 
an amusement park, a theme park, boring, tennis, a pool, a jogging, sea bathing, skiing, golf, golf 
course reservation, path guidance, a parking lot, and air-conditioner setting temperature and 
which raise air^conditioner setting temperature are described. 

[0057] (C-10): The contents showing the mental state or corporal state considered that a user 
becomes are beforehand described by the item of a state "a state." concrete — hungry — 
being hungry — before — movement — preparation (it is going to move — a state) — good 
condition — usual — being hot — a throat — a dry — energy — lively — a drive — enjoying 
oneself — **** — a meal — inside — music — appreciation — inside — television — 
appreciation — inside — a full stomach — fatigue — returning — — playing — ^ — eariy - 

- the destination — reaching — ** — a break — inside — being irritated — **** — getting 
angry — **** 

[0058] (C-1 1): The contents of the item relevant to the contents of description of other items 
(especially, "a classification", "a demand", "user utterance", "activity") in the dialog data are 
described by the item of personal information "personal information" among each item (P-1 to 
P-1 1 ) of a user profile mentioned above. 

[0059] And there are that the contents of fixation are beforehand described to be as an item of 
this "personal information", and a thing by which the contents of description are changed by the 
system control section 21 according to the user profile actually memorized by the user profile 
storage section 37. For example, in the dialog data of the line LB illustrated to drawin g 4 , the 
contents (this example those with a child) corresponding to the item of the (P-1 Irfamily 
composition) of a user profile are beforehand described by the item of "personal information." 
Moreover, in the dialog data of the line LI 7 illustrated to drawing 6 , the contents (at this 
example, skiing is a hobby) corresponding to the item of a (P-8:hobby) of a user profile are 
beforehand described by the item of "personal information." 

[0060] on the other hand, line LI 6 illustrated to drawing 6 a dialog — data — setting — " — an 
individual — information — " — an item — it can set — [ — ] — inside — **** — system 
control — the section — 21 — a user profile — ( — P - ten — : — shopping — the purpose — 
good — going — a place — ) — an item — describing — having had — the contents (this 
example A department store) — describing — having . moreover, line LI 8 illustrated to drawing 6 
a dialog — data — setting — " — an individual — information — " — an item — it can set — 
[ — ] — inside — **** — system control — th section — 21 — a user profile — ( — P - nine - 

- : — a hobby — the purpose — good — going — a place — ) — an item — describing — 
having had — the cont nts (this example D golf course) — describing — having . 

[0061] the above-mentioned line LI 6 and LI 8 " — an individual — information — " — an item - 

- :MoMc — beforehand — a user profile — each — an item — insid — any — an item — 
describing — having had — th contents — [ — ] — inside — d scribing — a thing — being 
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shown — directions — data — setting — having — ^moic* — system control — the section — 
21 — the above — directions — data — being based — " — an individual — information — " — 
an item Therefore, the above-mentioned line LI 6 and LI 8 The contents of description of the 
, item of "personal information" will be changed into the user profile storage section 37 according 
to the actually memorized user profile. 

[0062] In addition, the above-mentioned line LI 8 The contents of a hobby in golf are also 
• beforehand described by the item of the "personal information" in dialog data. 

(C-12): The keyword under utterance of the user expected to be inputted through a microphone 

5 and the voice input section 25 is beforehand described by the item of user utterance "user 
utterance." And with this operation form, the keyword group described by the item of this "user 
utterance" serves as a recognition vocabulary of the control unit 1 concerned. 

[0063] However, line L1 1 illustrated to drawing 5 The keyword described in < <» according to 
the item of "user utterance" in dialog data is a variable data supposing the proper noun showing 
the name of a place being inputted, and the keyword described in □ is a variable data supposing 
the language showing the kind of cooking being inputted. Moreover, line LI 7 illustrated to drawing 

6 The keyword described in < <» according to the item of "user utterance" in dialog data is a 
variable data supposing the proper noun showing the name of a mountain being inputted. 
[0064] (C-13): The activity of the device M3 corresponding to the contents which the activity at 
the time of the control unit 1 concerned operating a device M3 (the contents of the agent 
utterance which should be outputted from a loudspeaker 7, and activity of other devices oth r 
than loudspeaker 7) is beforehand described, and described by the dialog data especially in the 
above (C-1> of - (C-12) and each item is described by the item of activity "activity." 

[0065] For example, while making the CD-ROM drive or communication device 1 7 with which 
navigation equipment 9 was equipped search a nearby restaurant from a its present location in 
the item of "activity", is it "meal from a loudspeaker 7 in the dialog data of the line L9 illustrated 
to drawin g 5 , based on the reference result? this — if it becomes cjosely, there is a store of the 
<a>, <b>, <c>, etc. affair <X1 > Where does it eat? The activity of the device M3 of making the 
agent utterance " output is described beforehand. In addition, a communication device 17 is 
made to communicate with the Internet broadcast terminal, and is made to search required 
information from the Internet. 

[0066] Moreover, line L10 illustrated to drawing 5 In dialog data in the item of "activity" While 
making the above-mentioned CD-ROM drive or a communication device 1 7 search two near 
parking areas (or service area) from a its present location If it is an after «e> parking area to a 
parking area, it is a part for after <X3 >. the reference result — being based — "<d> from a 
loudspeaker 7 — [ of a part for X2 >, and a degree ] The activity of the device M3 of making the 
agent utterance " output is described beforehand. 

[P067] Furthermore, for example, in the dialog data of the line LI 9 illustrated to drawing 7 , the 
degree of "room air temperature is over 40 degrees C from the loudspeaker 7 in the item of 
"activity." Air-conditioner setting temperature is lowered. While making the agent utterance " 
output, the activity of the device M3 of making the temperature of the vehicle interior of a room 
lowered to air-conditioner equipment 1 3 is described beforehand 

[0068] in addition — drawin g 5 — and — drawin g 6 — setting — " — activity — " — an item — 
indicating — having had — < — > — inside — a character — inside — a — from — k — up to 
— the alphabet — O — O — a restaurant — and — C — a mountain — a skiing area — Th 
proper noun obtained by reference operation (specifically, a, b, c, f, and OO restaurant) The 
searched restaurant name, the parking-area name with which d and e were searched, the parking 
lot name with which g was searched, the road name with which h and i were searched, and the 
shopping center name with which j and k were searched — it is — XI from — X5 up to — the 
sign which starts in X Numeric values acquired by reference operation, such as a number and 
time It is (the numeric value which sp cifically expresses the time of the restaurant f where th 
numeric value showing the total number of cases, such as the restaurants a, b, and c wh re XI 
was searched, X2. the num ric value showing the duration to the parking areas d and e with 
which Xthree was search d, X4, and X5 were searched which can be reserved). 
[0069] As an item of "activity", th re are some by which the contents of d scription ar 
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changed by the syst m control section 21 according to th us r profile actually memoriz d by 
the user profile storage section 37 like the item of "p rsonal information" on th other hand 
further for example, line LI 6 illustrated to drawing 6 □ [ in / the item of "activity" / on 

. dialog data and ] — inside, the contents (this example A department store) described by the 
(item which goes by the purpose of P-10:shopping well) of a user profile are described by the 
system control section 21 moreover, line LI 8 illustrat d to drawing 6 □ [ in / the item of 

" "activity" / on dialog data and ] — inside, the contents (this example D golf course) described 
by the (item which goes by the purpose of a P-9:hobby well) of a user profile are described by 
the system control section 21 

[0070] the above-mentioned line LI 6 and LI 8 " — activity — " — an item — 'MoMe — 
beforehand — a user profile — each — an item — inside — any — an item — describing — 
having had — the contents — [ — ] — inside — describing — a thing — being shown — 
directions — data — setting — having — sK*** — system control — the section — 21 — the 
above — directions — data — being based — " — activity — " — an item — it can set — 
[ Therefore, the above-mentioned line LI 6 and LI 8 The contents of description of the item of 
"activity" (in the case of this example the contents of agent utterance) will be changed into the 
user profile storage section 37 according to the actually memorized user profile. 
[0071] as the activity of the device M3 which the item of "activity" of the line LI 6 illustrated to 
drawin g 6 shows when it explains concretely — above — □ — while making a communication 
device 1 7 search from the Internet the target product of the bargain performed at A department 
store described inside today, is it "A department store from a loudspeaker 7 based on the 
reference result? The bargain of OO (for example, electrical machinery supply) is done today. It 
becomes a thing of making the agent utterance " output, moreover — as the activity of the 
device M3 which the item of "activity" of the line LI 8 illustrated to drawin g 6 shows — above - 
- □ — is it "D golf course from a loudspeaker 7 based on the contents (D golf course) described 
inside? Is resen/ation status investigated? It becomes a thing of making the agent utterance " 
outpuL 

[0072] (C-14): In the item of a presumed demand "a presumed demand" While the actual 
situation that the user is placed turns into a situation described in the item (C-2 to C-8) of the 
situation in the dialog data A user utters the keyword described by the item (C-1 2) of "user 
utterance" in the dialog data. Furthermore, when it is assumed that device operation described 
in the item (C-1 3) of the "activity" in the dialog data was actually performed, the content of the 
demand sensibly considered that a user has is described beforehand. 

[0073] And the variation (kind) of the content described by the item of this "presumed demand" 
is the same as that of the content described by the item of a "demand" mentioned above. 
(C-1 5): In the item of a presumed state "a presumed state" While turning into a situation 
described in the item (C-2 to C-8) of the situation in the dialog data, the actual situation that 
the user is placed as well as the item of a "presumed demand" A user utters the keyword 
described by the item (C-1 2) of "user utterance" in the dialog data. Furthermore, when it is 
assumed that device operation described in the item (C-1 3) of the "activity" in the dialog data 
was actually performed, the content in the state where it is thought sensibly that a user 
becomes is described beforehand. 

[0074] And the variation of the content described by the item of this "presumed state" is the 
same as that of the content described by the Item in the "state" where it mentioned above. 
(C-1 6): The content of demand with the another content described in the item of "a presum d 
demand" in the dialog data among the demands sensibly considered that a user has in the item 
of a presumed related demand "a presumed related demand" based on the same assumption as 
the item of the above "a presumed demand" is described beforehand. 
[0075] And the variation of the content described by the item of this "presumed jelated 
demand" is the sam as that of the content described by the item of a "demand" mentioned 
above. In addition, in this operation gestalt, although the content is describ d by all dialog data 
about two items of "a classification" and "activity" as shown in drawin g 4 - drawin g 8 . th 
content may not be described about oth r items. That is. the portion of the blank in drawing 4 - 
drawing 8 shows that th cont nt is not described. And according to the content described in 
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the item of "activity", it should just determine wheth r the content is described in which it ms 
other than "a classification" and "activity." However, the corresponding content is describ d by 
at least one or more items among items oth r than "a classification" and "activity." 

. [0076] Next, in the control unit 1 of this operation gestalt constituted as mentioned above, the 
processing performed in the system control s ction 21 is explained using drawin g 3 . As shown in 
drawin g 3 , when vehicles are ignition switched off (illustration ellipsis) and a power supply is 

" supplied to the control unit 1 concerned, the system control section 21 At Step (it is hereafter 
described as "S") 110, it first minds any with an input unit 3, I/F23 and a microphone 5, and the 
voice input section 25 they are. The identification information (for example, a name, a password, 
an identification number, a card number, etc.) from the present user (user) inputted as a key 
input or voice is read. In addition, you may make it read the information on ah ID card as 
identification information. 

[0077] And the user profile the content (a name and other identification information) described 
by the item (P-2) mentioned above out of the two or more man-minutes user profile memorized 
by the user profile storage section 37 in SI 20 continuing and whose identification information 
read by the above S1 10 correspond is specified, and the specified user profile is memorized to 
the buffer area beforehand set up in RAM as the present user's user profile. 
[0078] And a content setup of the dialog database in the dialog data-storage section 35 is 
further performed in SI 30 continuing using the user profile memorized to the above-mentioned 
buffer area. That is, based on the directions data, the content of the user profile in the above- 
mentioned buffer area is described about the dialog data with which the directions data 
mentioned above among each set talk data which constitute a dialog database are set. the line 
LI 6 illustrated to drawing 6 by this processing of SI 30 and L18 a dialog — data — it can set — 
" — an individual — information — " — " — activity — " — each — an item — [ — ] — inside - 
- present — a user — being peculiar — the content — describing — having — . 
[ and ] 

[0079] Furthermore, in these SI 30. the content of the agent utterance described by the item of 
"activity" of a dialog database is changed to that from which a tone differs according to the 
instructions from a user inputted through an input unit 3 and I/F23. That is. in the control unit 1 
of this operation gestalt, the character on utterance of the equipment 1 concerned (tone) can be 
changed now into condition, such as the man in the street, the president, a young man, a friend, 
and a girl, corresponding to the instructions from a user. In addition, the content of the agent 
utterance illustrated to drawin g 4 - drawin g 8 is standard form when a user specifies the "man in 
the street." 

[0080] Next, in order that the system control section 21 may search the dialog data which suited 
the actual situation that the user was placed from the dialog database by processing after S220 
Ipter mentioned in SI 40 Based on the data of the clock built in self, time (a year, the moon, a 
day, time), the present four seasons, a present time zone, etc. detect the actual situation 
corresponding to the "season" of a dialog database, and the item of "a time zone or time", and 
memorize the detection result to the above-mentioned buffer area. 

[0081] Moreover, the system control section 21 describes the present time in the item of the 
"time zone or time" about the dialog data (dialog data of the line L1 1 illustrated to drawin g 5 
with this operation gestalt) which need to describe the content in the item of "a time zone or 
time" among each set talk data which constitute a dialog database from these SI 40 as 
mentioned above. 

[0082] And while reading the present location of vehicles from navigation equipment 9 in SI 50 
continuing, the destination whose intention the user has is read from navigation equipment 9, or 
it grasps according to the content of a dialog with the user till then, and the their present 
location and destination which were detected in this way are memorized to the above-mentioned 
buffer area. 

[0083] Moreover, the system control section 21 describes the actual destination in the item f 
the "destination" about the dialog data (the line LI 2 illustrated to drawin g 5 with this operation 
gestalt, and dialog data of LI 3) which n d to d scribe the cont nt in the it m of the 
"destination" among each set talk data which constitute a dialog database from these SI 50 as 
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mentioned above. Furthermore, the system control section 21 describ s an actual pr sent 
location in the item of the "present location" about the dialog data (dialog data of line L1 1 -LI 3 
illustrated to dr awin g 5 with this operation gestalt) which need to describe the content in the 
, item of a "present location" among each set talk data which constitute a dialog database from 
these S150 as mentioned above. 

[0084] Next, by the Internet reference through the communication device 1 7 etc., by the 
■ classification of following ** - the system control section 21 checks the seasonal event and 
event a its present location and near the destination, and memorizes the result to the above- 
mentioned buffer area SI 60 continuing. 

: seasonal events common to the whole country, such as the New Year and Christmas. 
[0085] ♦* : the event held every year although a festival etc. is local. 
^ : the event held to a local and special schedule. 

And the dialog data whose content of description of the item of a "classification" is "a greeting" 
among each set talk data which constitute a dialog database from SI 70 continuing The detection 
result memorized by the above-mentioned buffer area by processing of the above SI 40 and 
SI 50 out of (the dialog data of the lines L1-L6 specifically illustrated to drawing 4 ) (a season, a 
time zone, time, the destination, its present location), The dialog data which suit most the 
detection result (the environment of the circumference of vehicles, the situation outside a 
vehicle, in-the-car situation) of the actual situation which was detected by the processing of 
S200 mentioned later and was memorized by the above-mentioned buffer area are searched. 
And the text data of the content of the agent utterance described by the item of "activity" of 
the searched dialog data is further outputted to the speech synthesis section 27. and the 
utterance for "good morning" and the greeting of "hello" (agent utterance) is made to output 
from a loudspeaker 7. 

[0086] For example, if the present time detected by the above SI 40 is from 4:00 before 1 1 :00, 
the dialog data of the line LI illustrated to drawin g 4 will be searched, and the utterance of 
"good morning" will be performed from a loudspeaker 7. Moreover, if the present time detected 
by the above SI 40 is from 1 1:00 before 1 8:00, the dialog data of the line L2 illustrated to drawin g 

4 will be searched, and the utterance of "hello" will be performed from a loudspeaker 7. 
[0087] in addition, the 1 st time immediately after supplying a power supply to the control unit 1 
concerned, as for the processing for this greeting utterance of SI 70 — or it is carried out only 
when predetermined conditions when going ahead with a dialog with a user and going are 
satisfied further Next, the silent state where a sound signal is not inputted through a microphone 

5 and the voice input section 25 in SI 80 the system control section 21 When it judges and a 
sound signal is inputted within the above-mentioned fixed time (S180:NO), whether it continued 
more than fixed time set beforehand, and continued While extracting the keyword (utterance 
Keyword) which the user uttered from the sound signal by which the input was carried out 

[ above-mentioned ] by progressing to SI 90, voice input processing which memorizes the 
extracted keyword to the above-mentioned buffer area is performed. And it progresses to S200 
after that. 

[0088] Moreover, when it judges with the silent state having continued more than fixed time, and 
having continued by the above SI 80 (S180:YES), the content of "being silent (or no response)" 
is memorized to the above-mentioned buffer area, and it progresses to it after that S200. And in 
S200, among the actual situations (real situation) that the user is placed, processing for 
detecting real situations other than the item detected by the above SI 40 and SI 50 (that is, time 
and being a real situation except spatial the environment of the circumference of vehicles, the 
situation outside a vehicle, and each fruit situation of an in-the-car situation) is performed, and 
the detection result is memorized to the above-mentioned buffer area. 
[0089] inside [ being described by each item of "environment" of a dialog database, "the 
situation outside a vehicle", and a "in-the-car situation" by processing of S200 here ] — ^ 
and a real situation are d t cted just For example, the real situation of the passage environm nt 
any, such as a highway, an ordinary road, a national highway, and a prefectural road, th 
passages under present run ar among "environment" of the circumference of vehici s. The real 
situation of the traffic environment wh re the speed limit of the passage under pres nt run and 
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the passage under present run are one-way traffic, or it is DO NOT ENTER. Each with th r al 
situation of the geography environment where the current position of vehici s is n ar marine, or 
it is in a mountain receives VIGS information (information from the broadcast terminal of VICS) 
, by the communication device 1 7, or detects it based on the information (current position and 
map data) from navigation equipment 9. And the real situation in the passage state of the 
passage under present run having frozen or being easy to slide among "environment" of the 
circumference of vehicles is detected based on the information from other control units which 
are controlling the brake gear. 

[0090] Moreover, each of the real situation of the weathers (being fine cloudiness, a light rain, 
rain, heavy rain, snow, thunder, a typhoon, etc.) of a present location and the destination and the 
real situation of the traffic situation of the passage under present run being congested, or having 
become empty is detected by receiving VICS information by the communication device 1 7 among 
''the situations outside a vehicle." In addition, it is also detectable from the signal of the raindrop 
sensor of the various sensors 19 that the weather of a its present location rains. And the signal 
and camera from the ultrasonic sensor of the various sensors 19 detect the real situation of 
vehicles circumference situations, such as existence of flattery vehicles, and existence of 
precedence vehicles, among "the situations outside a vehicle." 

[0091] On the other hand, the signal from the temperature sensor of the various sensors 19 
detects the real situation of the degree of room air temperature among "in-the-car situations." 
Moreover, the signal from the pressure sensor which detects the pressure which joins the 
bearing surface of a sheet detects the real situation of the entrainment state of the number of 
crews of vehicles (one person, two persons, three persons or more) among "in-the-car 
situations." 

[0092] Among "in-the-car situations", and operational status (a run by the congested passage, a 
comfortable run, those with oscillating, etc.). An entrainment state (detailed content what man is 
sitting on the family companion and which seat). Or called it further the move purposes (a drive 
with a family, a drive with a friend, date with a sweetheart, etc.). About a real situation 
automatically undetectable using the information from navigation equipment 9, a communication 
device 1 7, the various sensors 1 9, other control units, etc. It detects because I ask by the 
message displayed on utterance and display 1 1 from a loudspeaker 7 to a user and have you 
teach by voice or key input from a user. 

[0093] Next, the system control section 21 performs processing for presuming the present 
demand of a user and a state in S210. The dialog data used for operating a device M3 out of a 
dialog database by processing of S210 here by processing of the last time of S270 and S280 
mentioned later are read. The content described by both the items of "the presumed demand" 
of dialog data and "a presumed related demand" which were read it memorizes to the above- 
mentioned buffer area as a demand presumed that the user has now; and the content further 
described by the item of the "presumed state" of the dialog data which carried out [ above- 
mentioned ] reading appearance is memorized to the above-mentioned buffer area as a state 
presumed that the user has become now 

[0094] For this reason, when processing of S210 is finished, the present user's user profile 
(personal information), the keyword (however, silent or the content of a no response is also 
included) which the user uttered, the content showing the real situation that the user is plac d, 
and the content which presumed the demand of a user and the state will be memorized by the 
above-mentioned buffer area in RAM. 

[0095] Then, in S220 continuing, the system control section 21 accesses a dialog database, and 
reads each set talk data. The content described by each item of a "season", "a time zone or 
time", the "destination", a "present location", "environment", "the situation outside a vehicle", 
a "in-the-car situation", "a demand", a "state", "personal information", and "user utterance" 
about each set talk data. Matching with the content memorized by the above-mentioned buffer 
area is investigated. 

[0096] The content the user specifically presumed matching with the k yword which actually 
spoke, and the keyword described by the it m of "user utterance" of dialog data, and the 
demand of a user to be, The content which presumed matching with the content describ d by 
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the item of "a demand" of dialog data, and a user s condition. Each cont nt showing th r al 
situation that matching with the cont nt described by th item of the "state" of dialog data and 
the user are placed, Matching with the content described by each item of a ''season", "th time 

^ zone or time" of dialog data, the "destination", a "present location", "environment", "the 

situation outside a vehicle", and a "in-the-car situation", and the present user s user profile. It 
investigates about each of matching ** with the content described by the item of the "personal 

" information" on dialog data. 

[0097] Moreover, especially in these S220, the dialog data with which the content is described by 
the item of "a demand" and "user utterance" are preferentially read among the dialog data in a 
dialog database. And as processing for investigating matching, it gives [ predetermined value / 
every / (for example, one point) ] about each above-mentioned item of the read dialog data to 
the content and match which are memorized by the above-mentioned buffer area, and let the 
sum total mark be an evaluation value showing the degree of matching. However, you may 
change mark about the specific item of each item of dialog data. 

[0098] And by processing of S220, the line number (namely, number of Line L shown in drawin g 4 
- drawing 8 ) is further memorized about N dialog data (for example, eight pieces) sequentially 
from what has the computed largest evaluation value among each set talk data to a different 
specific field from the above-mentioned buffer area beforehand set up in RAM. 
[0099] And the greatest evaluation value computed by the above S220 in S230 continuing (that 
is, among N dialog data with which the line number was memorized to the above-mentioned 
specific field) If the evaluation value of the dialog data whose computed evaluation value is the 
maximum Judges whether it is larger than the threshold set up beforehand and is not larger than 
the threshold It judges that the contents (a user's utterance keyword or the content of a real 
situation) which should be detected by processing of SI 90 or S200 mentioned above are 
insufficient, and shifts to S240. 

[0100] And in these S240, the utterance which asks a user the content of detection which run 
short is outputted from a loudspeaker 7, and it returns to SI 80 after that. Then, although 
processing of S180-S220 will be performed again, when an inquiry to the user by processing of 
S240 is performed in this way, by S220, an evaluation value is calculated by the above- 
mentioned specific field only about N dialog data with which the line number was memorized 
[0101] Moreover, when it judges with the greatest evaluation value computed by the above S220 
by the above 8230 being larger than a threshold, it progresses to S250. In these S250, when it 
judges whether there are two or more dialog data whose computed evaluation values are the 
maximum to the above-mentioned specific field and more than one are in it about it among N 
dialog data with which the line number was memorized, it judges that it is necessary to narrow 
down one dialog data from two or more of the dialog data, and shifts to 8260. 
[D1 02] And in these S260, the utterance which asks a user the content for narrowing down one 
dialog data from two or more above-mentioned dialog data is outputted from a loudspeaker 7, 
and it returns to 8180 after that. Then, although processing of 8180-8220 will be again 
performed also in this case, when an inquiry to the user by processing of 8260 is performed in 
this way, by 8220, an evaluation value is calculated by the above-mentioned specific field only 
about N dialog data with which the line number was memorized. 

[0103] On the other hand, when a negative judging is carried out by the above 8250 (i.e., when 
the number of the dialog data whose evaluation values are the maximum among N dialog data 
with which the line number was memorized to the above-mentioned specific field is one) It 
progresses to 8270, the dialog data with which the evaluation value became the maximum are 
read, and the content described by the item of "activity" of the dialog data is set up in RAM as 
activity of a device M3. And a device M3 is operated according to the activity set up by the 
above 8270 in 8280 continuing. 

[0104] That is, among each set talk data which constitute a dialog database from processing of 
8220-8280 The content a "season", "a time zone or time", the "destination", a "pres nt 
location", "environment", "the situation outside a vehici ", a "in-the-car situation", "a 
demand", a "state", "personal information", and the content described by each item of "us r 
utt ranee" are remembered to be by the abov -mention d buffer area (the real situation that 
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the us r is placed) The content to expr ss, the content which presumed th demand of a user 
and the state, the present us r s user profile. And the dialog data which suit d most are 
searched and chosen as the keyword which the user uttered, and it is made to operate the 
^ devices M3 including a loudspeaker 7 according to the content described by "activity" of the 
selected dialog data. 

[0105] And it judges whether after that, it progressed to S290 and the dialog with a user was 
" completed. In addition, in this judgment, when "it being noisy" from a user and the utterance 
keyword of "good-bye" are inputted, it judges with the dialog having been completed, for 
example. And although it returns to SI 40 when it judges with the dialog not being completed, 
when it Judges with the dialog having been completed, processing of the drawin g 3 concerned is 
ended. 

[0106] Next, an example is given and explained about an operation of the above control units 1. 
First, if a user utters keywords, such as a "meal" and "boiled rice", when vehicles are running 
the ordinary road, the dialog data of the line L9 illustrated to drawing 5 will be chosen by 
processing of S220-S280, and the content described by the item of "activity" of the dialog data 
(L9) will be set up as activity of a device MS. A nearby restaurant is searched by the CD-ROM 
drive or communication device 1 7 of navigation equipment 9 from a its present location. 
Consequently, is it "meal from a loudspeaker 7? this — if it becomes closely, there is a store of 
the <a>, <b>, <c>. etc. affair <X1> Where does it eat? The agent utterance " is outputted. 
[0107] On the other hand, line L10 which will be illustrated to drawing 5 by processing of S220- 
S280 if a user utters keywords, such as a "meal" and "boiled rice", when vehicles are running 
the highway Dialog data are chosen and the content described by the item of "activity" of the 
dialog data (L10) is set up as activity of a device MS. Agent utterance that consequently, it is a 
part for after <XS> if two near parking areas are searched by the CD-ROM drive or 
communication device 1 7 of navigation equipment 9 from a their present location and it is an 
after «e> parking area from a loudspeaker 7 to "<d> parking area" is outputted. [ of a part for 
X2 > and a degree ] 

[0108] Thus, in the control unit 1 of this operation gestalt, the activity of a device MS is 
changeable according to the actual situation that not only a user s utterance keyword inputted 
through a microphone 5 and the voice input section 25 but the user is placed. Therefore, even if 
a user s content of utterance is the same, according to the situation that the user is placed, 
activity of a device MS can be made the optimal and device operation (in the case of this 
example, it is information offer operation) based on the request of the user by the fewer input 
from a user can be realized. 

[0109] When vehicles are running the ordinary road of Aichi Prefecture and Kariya-shi and a user 
utters the three keywords "Okazaki", a "meal", and the "India food", on the other hand, by 
processing of S220-S280 Line L1 1 illustrated to drawing 5 Dialog data are chosen and the 
content described by the item of "activity" of the dialog data (L1 1 ) is set up as activity of a 
device MS. Agent utterance that consequently, the time of Restaurant f and Restaurant f of the 
India food in Aichi Prefecture and Okazaki-shi which can be reserved is searched by the 
communication device 1 7 from the Internet etc., and <f> can be reserved to a part for <X5 > at 
the time of a loudspeaker 7 to " <X4>" is outputted. In addition, the above-mentioned line L1 1 In 
dialog data, <Kariya> is described by the item of a "present location" by the processing of SI 50 
till then. 

[0110] And it is the above-mentioned line L11 in this way. When dialog data are chosen By the 
following processing of S210, it is a line L1 1. The contents (a meal, a picnic, a parking lot, a 
break, drink) described by both the items of "a presumed demand" of dialog data and "a 
presumed related demand" While the above-mentioned buffer area memorizes as a demand a 
user is presumed to be, it is a line L1 1 . The contents (before [ hungry ]) described by the item of 
the "presumed state" of dialog data are m moriz d by the above-mentioned buffer area as a 
state where a user is presumed. 

[01 1 1] For this reason, the above-mentioned line L1 1 If esp cially a user does not answer after 
the agent utterance according to dialog data is performed Lin LI 2 illustrated to drawing 5 by 
the following processing of S220-S280 Dialog data (Namely, the dialog data with which the 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi^eije 



200S/02/0S 



15/20 ^— V 



"ordinary road" was describ d by the item of "environment" and th "meal" and th "parking 
lot" w re described by the it m of a "demand") are chosen, and the content described by the 
item of "activity" of the dialog data (LI 2) is set up as activity of a device M3. Cons quently, the 
parking lot g near the above-mentioned restaurant f is searched by the communication device 1 7 
from Vies information etc., and ag nt utterance of "<g> being vacant as for a parking lot" from 
the loudspeaker 7 is outputted. In addition, the above-mentioned line LI 2 In dialog data, <the 
restaurant f in Okazaki> and <Kariya> are described by each item of the "destination" and a 
"present location" by the last processing of SI 50, respectively. 

[0112] Furthermore, it is the above-mentioned line LI 2 in this way. When dialog data are chosen 
By the following processing of 8210, it is a line LI 2. While the contents (path guidance) 
described by the item of "a presumed demand" of dialog data are memorized by the above- 
mentioned buffer area as a demand a user is presumed to be Line LI 2 The contents (preparation 
of movement) described by the item of the "presumed state" of dialog data are memorized by 
the above-mentioned buffer area as a state where a user is presumed. 

[01 13] For this reason, the above-mentioned line LI 2 If especially a user does not answer after 
the agent utterance according to dialog data is performed Line LI 3 illustrated to drawing 5 by 
the following processing of S220-S280 Dialog data (Namely, the dialog data with which the 
"ordinary road" was described by the item of "environment" and "path guidance" was described 
by the item of a "demand") are chosen, and the contents described by the item of "activity" of 
the dialog data (LI 3) are set up as activity of a device M3. Agent utterance of consequently, 
recommending you to go by <i> since the main roads h and i and the traffic congestion situation 
of Roads h and i for going to the destination (Aichi Prefecture and Okazaki-shi) from a present 
location (Aichi Prefecture and Kariya-shi) were searched by the communication device 1 7 from 
Vies information etc. and " <h> is crowded from the loudspeaker 7 with the communication 
device" is outputted. In addition, the above-mentioned line LI 3 In dialog data, <Okazaki> and 
<Kariya> are described by each item of the "destination" and a "present location" by the last 
processing of SI 50, respectively. 

[01 14] On the other hand, when the dialog data of a line L9 mentioned above are chosen By the 
following processing of S210, the contents (a meal, a parking lot. a break, drink) described by 
both the items of "a presumed demand" of the dialog data of a line L9 and "a presumed related 
demand" While the above-mentioned buffer area memorizes as a demand a user is presumed to 
be, the contents (hungry) described by the item of the "presumed state" of the dialog data of a 
line L9 are memorized by the above-mentioned buffer area as a state where a user is presumed. 
[01 1 5] for this reason — for example, if the user uttered the keyword "the place where 
somewhere is good" and has moreover got on by the family companion in that case, after the 
agent utterance according to the dialog data of the above-mentioned line L9 is performed Line 
LI 4 illustrated to drawing 6 by the following processing of S220— S280 Dialog data (Namely, an 
"ordinary road" is described by the item of "environment" and a "family companion" is 
described by the item of a "in-the-car situation".) A "meal" is described by the item of a 
"demand" and "**3Mc" is described by the item of a "state." The dialog data with which "the 
place where somewhere is good" was described are chosen as the item of "user utterance", and 
the contents described by the item of "activity" of the dialog data (LI 4) are set up as activity of 
a device M3. Consequently, from the Internet etc. to a present location, a nearby family 
restaurant is searched by the communication device 1 7, and the agent utterance "how it is at 
00 restaurant" is outputted from a loudspeaker 7 by it 

[0116] While people have ridden on in the car, when the temperature of the vehicle interior of a 
room is 30 degrees 0 or more and the demand of a user presumed by processing of S210 
moreover is not "air-conditioner operation needlessness", for example, moreover, by processing 
of S220-S280 Line L20 illustrated to drawing 7 Dialog data are chosen and the contents 
described by the item of "activity" of the dialog data (L20) are set up as activity of a device M3. 
Consequently, loudspeaker 7 shell "Is it hot? Is air-condition r setting temperature lowered? 
Agent utterance of the question " is outputted. 

[01 1 7] And it is the above-mentioned line L20 in this way. When dialog data are chosen By the 
following processing of S210, it is a line L20. While the contents (air-conditioner setting 
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temperature is lowered) described by the item of "a presumed demand" of dialog data are 
memorized by the above-mentioned buffer area as a d mand a us r is presumed to be Lin L20 
The contents (a hot throat is a dry) described by the item of the "presum d state" of dialog 
data are memorized by the above-mentioned buffer area as a state where a user is presumed. 
[01 18] For this reason, the above-mentioned line L20 That a user is in and " , and well 
[ "well" ] or the keyword of "lowering" is uttered, or it is a no response after the agent 
utterance according to dialog data is performed by processing of S220-S280 Line L22 illustrated 
to drawing 8 Dialog data are chosen and the contents described by the item of "activity" of the 
dialog data (L22) are set up as activity of a device M3. Consequently, loudspeaker 7 shell "I 
understand. Air-conditioner setting temperature is lowered. While the agent utterance " is 
outputted. it will operate so that air^conditloner equipment 13 may lower the temperature of the 
vehicle interior of a room. 

[01 1 9] On the other hand, the above-mentioned line L20 If a user utters "no" and the keyword 
of "not continuing [ "disagreeable" or / this ] not lowering" after the agent utterance according 
to dialog data is performed, [ "lowering" ] Line L23 illustrated to drawing 8 by processing of 
S220-S280 Dialog data are chosen and the contents described by the item of "activity" of the 
dialog data (L23) are set up as activity of a device M3. Consequently, while agent utterance of 
"carrying out with this" from a loudspeaker 7 is outputted, it will operate so that air-conditioner 
equipment 1 3 may maintain the temperature of the vehicle interior of a room. 
[0120] Moreover, line L21 which will be illustrated to drawing 7 by processing of S220-S280 if a 
user utters the keyword " »** * ** " and ''jmc^^mc*****'' when the temperature of the vehicle 
interior of a room is 20 degrees C or more Dialog data are chosen and the contents described by 
the item of "activity" of the dialog data (L21) are set up as activity of a device M3. 
consequently, the case where the dialog data of a line L20 mentioned above are chosen — the 
same — "from a loudspeaker 7 — hot — coming out — a shank Is air-conditioner setting 
temperature lowered? Agent utterance of the question " is outputted. 

[0121] And it is the above-mentioned line L21 in this way. When dialog data are chosen the 
following processing of S210 — line L21 The contents (air-conditioner setting temperature is 
lowered — I want to drink some — I want to rest) described by both the items of "a presumed 
demand" of dialog data and "a presumed related demand" While the above-mentioned buffer 
area memorizes as a demand a user is presumed to be, it is a line L21. The contents (a hot 
throat is a dry) described by the item of the "presumed state" of dialog data are memorized by 
the above-mentioned buffer area as a state where a user is presumed. 
[0122] For this reason, the above-mentioned line L21 If a user is in "and utters "and the 
keyword of "well" after the agent utterance according to dialog data is performed Line L22 
mentioned above by processing of S220-S280 Line L23 mentioned above by processing of S220- 
S280 when dialog data were chosen and the user uttered conversely "no" and the keyword of 
being "disagreeable" Dialog data will be chosen. 

[0123] That is, in the control unit 1 of this operation form, a demand of a user will be presumed 
by processing of S210 based on at least one of the actual utterance keyword from a user, a 
user's real situation, and the activity that actually operated the device M3. And the dialog data 
which have the demand presumed by processing of S210 as contents of description of the item 
of a "demand" are chosen by processing of S220-S280, and device operation is performed by it 
based on the activity described by the item of "activity" of the selected dialog data. In addition, 
it depends on the description state [ whether based on which contents, a demand of a user is 
presumed by processing of S210 among the actual utterance keyword from a user, a users real 
situation, and the activity of a device M3 ] of the dialog data used for operating a device M3 by 
last processing of S280. 

[0124] Therefore, according to the control unit 1 of this operation form, devic operation (in the 
case of the above-mentioned example, information offer operation and air-conditioner equipment 
1 3 operate) based more on the requ st of a us r is realizable. When running the ordinary road by 
the family companion in the time zone from 9:00 to 21:00 and a us r, for example, utt rs 
keywords, such as "shopping" and "shopping", next, by processing of S220-S280 Lin LI 5 
illustrated to drawing 6 Dialog data are chosen and the contents d scribed by the it m of 
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"activity" of the dialog data (LI 5) are set up as activity of a device M3. Consequ ntly, the 
nearby shopping centers j and k are searched by the CD-ROM drive or communication d vice 1 7 
of navigation equipment 9 from a their pr sent location, and agent utterance of "<j> and <k> 

, being in near if it is shopping" from a loudspeaker 7 is outputted. 

[0125] And it is the above-mentioned line LI 5 in this way. When dialog data are chosen By the 
following processing of S210, it is a line LI 5. While the contents (shopping, parking lot) described 

' by both the items of "a presumed demand" of dialog data and "a presumed related demand" are 
memorized by the above-mentioned buffer area as a demand a user is presumed to be Line LI 5 
The contents (preparation of movement) described by the item of the "presumed state" of 
dialog data are memorized by the above-mentioned buffer area as a state where a user is 
presumed. 

[0126] for this reason, the keyword [ user ] "a usual place" after the agent utterance according 
to the dialog data of the above-mentioned line LI 5 was performed — speaking — moreover — 
the item (P-10: — for the purpose of shopping) of the users user profile Line LI 6 which will be 
illustrated to drawing 6 by the following processing of S220-S280 if the contents described at 
the place which goes well are "A department stores" Dialog data are chosen. 
[0127] Namely, "9:00 to 21:00" are described by the item of "a time zone or time." An "ordinary 
road" is described by the item of "environment" and a "family companion" is described by the 
item of a "in-the-car situation." "Shopping" is described by the item of a "demand" and 
"preparation of movement" is described by the item of a "state," The dialog data (L16) with 
which "it goes to A department store well" was described by the item of "personal information", 
and "the usual place" was described by the item of "user utterance" are chosen. The contents 
described by the item of "activity" of the dialog data (LI 6) are set up as activity of a device M3. 
The target product of the bargain performed at A department store today is searched by the 
communication device 1 7 from the Internet etc. Consequently, is it "A department store from a 
loudspeaker 7? The bargain of OO (for example, electrical machinery supply) is done today. The 
agent utterance " is outputted. in addition — the above — a line — L — 16 — a dialog — data 
— setting — " — an individual — information — " — " — activity — " — each — an item — it 
can set — [ — ] — inside — **** — S — 1 30 — processing — present — a user — being 
peculiar — " — A — a department store — " — describing — having — **** . 
[0128] If the contents with which a user utters the two keywords "C mountain" and "skiing" at 
the season of winter, and is moreover described to be by the item (P-8 : hobby) of the user s 
user profile on the other hand are "skiing" Line LI 7 illustrated to drawing 6 by processing of 
S220-S280 Dialog data are chosen and the contents described by the item of "activity" of the 
dialog data (LI 7) are set up as activity of a device MS. Consequently, agent utterance of 
"starting the root guide to C mountain skiing area" from a loudspeaker 7 is outputted, and path 
guidance operation to C mountain skiing area from the present location by navigation equipment 
9 is started. 

[0129] Moreover, while the contents with which a user utters "golf" and two keywords of "being 
usual", and is moreover described to be by the item (P-8 : hobby) of the user's user profile, for 
example are "golf" if the contents described by the item (P-9: — the place which goes by the 
purpose of a hobby well) of this user profile are "D golf courses" Line LI 8 illustrated to drawing 
6 by processing of S220-S280 Dialog data are chosen and the contents described by the item of 
"activity" of the dialog data (LI 8) are set up as activity of a device M3. Consequently, is it "D 
golf course from a loudspeaker 7? Is reservation status investigated? The agent utterance " is 
outputted. in addition, the above-mentioned line LI 8 a dialog — data — setting — " — an 
individual — information — " — " — activity — " — each — an item — it can set — [ — ] — 
inside — **** — s — 1 30 — processing — present — a user — being peculiar — " — D — a 
golf course — " — describing — having — **** . 

[0130] Thus, in the control unit 1 of this operation form, the user profile which is information 
peculiar to a us r is set to one of the parameters at the time of choosing dialog data, and the 
activity of the device M3 according to the user s user profile is set up. Therefore, device 
operation adapted to the request peculiar to a user is realizabi . 

[0131] And while a two or more man-minutes user profile is memorized by the user profile 
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storage section 37, the present user s user profile is specifi d and it is mad to change 
automatically the contents (the cont nts of description of th item of "personal information" 
and "activity") of a dialog database by processing of S110-S130 according to the specified user 
profile. And the dialog data which suit the user profile which carried out [ above-mentioned ] 
specification are chosen, and it is mad to set up the activity of a device MS according to the 
contents described by the item of "activity" of the dialog data. 
• [0132] Therefore, even if which man of two or more persons the user profile was remembered to 
be by the user profile storage section 37 uses the control unit 1 concerned, he can change the 
activity of a device M3 for every man of the, and can realize device operation further based on 
the request peculiar to the user. Next, line LI 9 which will be illustrated to drawing 7 by 
processing of S220-S280 if people have ridden on in the car. the temperature of the vehicle 
interior of a room moreover rises and it becomes 40 degrees C or more Dialog data are chosen 
and the contents described by the item of "activity" of the dialog data (LI 9) are set up as 
activity of a device M3. Consequently, the degree of "room air temperature is over 40 degrees C 
from the loudspeaker 7. Air^cohditioner setting temperature is lowered. While the agent 
utterance " is outputted, it will operate so that air^conditioner equipment 1 3 may lower the 
temperature of the vehicle interior of a room. 

[0133] That is, in the control unit 1 of this operation form, dialog data are chosen only from the 
real situation of the user who detected, and the activity of a device M3 is set up. Therefore, 
when the situation that the user is placed turns into a specific situation, irrespective of other 
factors, such as a user's utterance, a device M3 can be operated in predetermined activity, and 
it is advantageous. 

[0134] As explained in full detail above, according to the control unit 1 of this operation form, 
according to a user's situation and a demand, operation of devices, such as the contents of 
utterance and air-conditioner equipment 13, can be made the optimal, and, moreover, a user can 
be exactly provided with useful information. Moreover, the dialog which has familiarity with a user 
can be performed and a sense of closeness can also be given to a user. 

[0135] In addition, with this operation form, processing of SI 80 and SI 90 is equivalent to the 
input means Ml, processing of SI 40, SI 50, and S200 is equivalent to the situation detection 
means M5, processing of S220-S270 is equivalent to the setting means M9, and processing of 
S280 is equivalent to the appliance control means M1 1. And processing of S210 is equivalent to 
the demand presumption means Ml 3, processing of S1 10 and SI 20 is equivalent to the 
discernment means Ml 9, and processing of SI 30 is equivalent to the change means Ml 7. 
[0136] Moreover, with this operation form, the dialog data-storage section 35 is equivalent to the 
data-storage means M7 for an activity setup, and the user profile storage section 37 is 
equivalent to the individual information-storage means Ml 5. And it is lines L9-L11, LI 5, and L21 
£imong the dialog data illustrated to drawing 4 - drawin g 8 . Dialog data It is equivalent to the 
data D1 for an activity setup, and is line LI 2 -LI 4, L20, L22, and L23. Dialog data It is equivalent 
to the 2nd data D2 for an activity setup, and is line LI 6 -LI 8. Dialog data are equivalent to the 
3rd data D3 for an activity setup, and it is a line LI 9. Dialog data are equivalent to the 4th data 
D4 for an activity setup. 

[0137] Next, other examples are explained. First in the control unit 1 of this operation form, the 
real situation of the weather is grasped with the instruction from VICS information and the user 
by the dialog, or the signal from a sensor (S200). In addition, what is necessary is to perform 
agent utterance of the inquiry "whether it has cleared up now", and just to get replies, such as 
"that is right" and "disagreeableness and raining", from a user, in receiving instruction from a 
user. 

[0138] Therefore, when the weather is fine, for example, the agent utterance "whether it is WX 
best to golf today" can be performed, and the dialog which has familiarity to a user can be 
carried out. moreover — the case where the agent utterance "whether the now of the autumnal 
leaves of Arashiyama is best time to see" is performed, or a time zone is daytime when a season 
is autumn since time, the present four seasons, and a present time zone are grasped in the 
control unit 1 of this operation form based on th data of the clock built in self (SI 40) for 
example, — " — is it the time of lunch boiled rice, soon? The n xt service area is 10km beyond. 
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Th agent utt ranee " can be performed and the dialog which has familiarity to a user can be 
carried out 

[01 39] on the other hand — a control unit — one — grasping — in the car — a situation — 
^ inside — entrainment — a state — it is — which — a seat — what — people — sitting down - 

- aMoM^ — or — ♦* — saying — being detailed — the contents — the following — [ — ] — inside 

— like — it can d scribe . 

' [SEATJD ,PSTYPEPATYPE,PTYPE PROFILE JD] 

In addition, SEATJD It is data showing the classification of a seat (sheet), and SEATJD =0 
shows a driver s seat, SEATJD =1 shows a passenger seat, SEATJD =2 show the backseat right, 
SEATJD =3 show the center of a backseat, and SEATJD =4 show the backseat left 
[0140] Moreover, PSTYPE is data showing crew's sex, PSTYPE=0 shows except human beings, 
such as a load and an animal, PSTYPE=1 shows a male, and PSTYPE=2 show a woman. 
Furthermore, PATYPE is data showing the classification of crew's age, PATYPE=0 shows a 
suckling, PATYPE=1 shows a small child, PATYPE=2 show a schoolchild, PATYPE=3 show a . 
junior high school student, PATYPE=4 show a high school student PATYPE=5 show a young 
man, PATYPE=6 show the man in the street and PATYPE=7 show an old man. 
[0141] And PTYPE Are data showing crew's type and PTYPE =0 shows an operator (driver). 
PTYPE =1 shows an operator's spouse and PTYPE =2 show an operator s child. PTYPE =3 show 
an operator s parents, PTYPE =4 show other families of an operator, PTYPE =5 show intimate 
persons other than a family, PTYPE =6 show an operator's acquaintance, and PTYPE =7 show 
other men. 

[0142] And PROFILE JD is data showing crew's name or name further. Therefore, for example, in 
[SEATJD, PSTYPE. PATYPE, PTYPE. and PROFILE JD] = [2. 1. 2. 2, and OO Tare], it means that 
00 Taro who is a boy schoolchild and is an operator's child is sitting on the backseat right 
[0143] And when a control unit 1 grasps such a situation, agent utterance like for example, 
following (1) - (3) and operation corresponding to it can be performed. 

(1) The time of vehicles stopping from a run state, "it stopped. When you come out outside Taro 
and a vehicle, please check back and open a door. Agent utterance of the warning " is 
performed. 

[0144] (2) The time of vehicles departing from a stop state, "depart The backseat right covers a 
child protector. While performing the agent utterance the child protector of a rear right-hand 
side door is made to be covered over other control units. 

(3) The time of a user uttering the two keywords "Taro" and a "TV phone", "introduce the 
camera of a TV phone to Taro. Whom is the partner who talks? After performing agent utterance 
of the inquiry other control units are made to turn and adjust the position posture and focus 
of a camera of a TV phone to Taro. 

[0145] moreover, for example [SEATJD. PSTYPE. PATYPE, PTYPE. and PROFILE JD] = [2. 2. 6. 
1. and OO Hanako] [SEATJD, PSTYPE. PATYPE. PTYPE. and PROFILE JD] =[2. 2. 0. and 2. O 
Mean holding OO pod the Hanako of whose is moreover a female suckling in her child by OO 
Hanako who is an operator's wife sitting on the backseat right in O pod or]. 

[0146] And when a control unit 1 grasps such a situation, according to the operation situation of 
vehicles, it is a sharp curve rightward from "300-meter beyond. Please hold Hanako. a pod, or 
****** firmly. Agent utterance of the warning " can be performed. 

[0147] On the other hand, the 12-bit data (it is hereafter described as AUDIO.ENV) explained 
below can describe the contents of the audio environment of the in-the-car situations which a 
control unit 1 grasps again. Namely, AUDIO_ENV When a least significant bit is made into the 0th 
bit. For example, the 0th the ON/the bit of the OFF of a cassette are shown, and the 1st the 
ON/the bit of the OFF of a CD player are shown. ON/OFF of MD player are shown, and a triplet 
eye shows the 2nd the ON/the bit of the OFF of DVD. It is shown whether the 4th bit of the FM 
broadcasting of radio is received, and it is shown whether the 5th bit of the AM broadcast of 
radio is received. The 7th the ON/th bit of the OFF of tel vision are shown, th 8th th 
ON/the bit of the OFF of video are shown, the 9th the ON/th bit of the OFF of a telephone are 
shown [ it is shown wheth r the 6th bit of the broadcast of a road traffic center is rec ived, ], 
and the 10th bit and the 1 1th bit are bits of un-using it or a r s rve. 
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[0148] Therefore, for example, in AUDIO_ENV = [1000 0001 0100], it means that a cass tt , 
television, and the telephone are turned on [ them ]. in addition — this xample — □ — the bit 
by the side of the inner leftmost is the 0th bit And when a control unit 1 grasps such a situation, 
the following agent utterance and operation corresponding to it can be performed, for example. 
[01 49] First, the time of a cassette, television, and the telephone being turned on [ them ] as 
mentioned above, ''he is on the telephone. Please lower the volume of a cassette and television. 
• The agent utterance " is performed. Furthermore, when it detected that vehicles went into the 
tunnel of a highway, it went into "tunnel. I tell broadcast of a road traffic center. After 
performing the agent utterance ". the volume of other audios (they are a cassette and television 
in this case) is lowered. In addition, this becomes AUDIO.ENV = [1000 001 1 0100]. 
[0150] And after performing the agent utterance of "Making a headlight turn on", a headlight is 
made to turn on. when it can come, simultaneously the headlight of vehicles is not turned on. As 
mentioned above, this invention cannot be overemphasized by that it is not limited to the above- 
mentioned operation form, and various forms can be taken although 1 operation form of this 
invention was explained. 

[0151] For example, although the control unit 1 of the above-mentioned operation form was 
carried in vehicles, it can apply this invention indoors similarly to the equipment which controls 
various built-in devices. Moreover, although the control unit 1 of the above-mentioned operation 
form inputted a user s utterance keyword, you may make it input the information by a user s key 
stroke as information in which the intention of a user was reflected. 
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* NOTICES * 

Japan Patent Off ic is not responsible for any 
damages caused by the use of this translation. 

1 . This document has been translated by connputer.So the translation may not reflect the original 
• * precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, with the above-mentioned conventional 
equipment, the activity (namely, the contents of reference what to search) of the device for 
information retrieval, the activity (namely, the contents of utterance with voice) of the device for 
voice outputs, etc. are set to one to one voice command. Therefore, in order to obtain device 
operation (the contents of reference, the contents of utterance, etc.) desired truly, the user did 
not have to be able to utter more voice commands and was not able to get desired device 
operation in many cases. 

[0006] For example, suppose that it programmed temporarily in equipment conventionally so that 
control action of searching the restaurant near a its present location to the utterance keyword 
of users, such as a restaurant and reference", and guiding this reference result with voice 
might be performed. However, when vehicles are running the highway in the case of this example, 
even if a user wants to come to have a meal and it speaks with "a restaurant and reference", 
the restaurant which can go only from an ordinary road will be shown and it will become 
meaningless information offer. 

[0007] In addition, such a problem is the same also about the case where a user inputs his 
intention not only when inputting his intention by utterance, but by the key stroke input etc. this 
invention is made in view of such a problem, is the fewer input from a user and aims at offering 
the control unit which can realize device operation adapted to the request of the user. 
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♦ NOTICES * 

Japan Pat nt Off ic is not responsible for any 
damages caused by the use f this translation. 

1 This docunnent has been translated by computer. So the translation may not reflect the original 
- precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawin g 1] It is the block diagram which illustrates the composition of the control unit of this 
invention. 

[ Drawing 2] It is a block diagram showing the composition of the control unit of an operation 
gestalt. 

[Drawing 3] It is a flow chart showing the processing performed with the control unit of an 
operation gestalt. 

[Drawing 4] It is the 1 of the drawings explaining an example of a dialog database. 
[Drawing 5] It is the 2 of the drawings explaining an example of a dialog database. 
[Dra w ing 6] It is the 3 of the drawings explaining an example of a dialog database. 
[ Drawin g 7] It is the 4 of the drawings explaining an example of a dialog database. 
[ Drawin g 8] It is the 5 of the drawings explaining an example of a dialog database. 
[Description of Notations] 

1 — Control unit 3 — Input unit 5 — Microphone 7 — Loudspeaker 

9 — Navigation equipment 1 1 — Display 1 3 — ^. Air-conditioner equipment 

15 — Audio equipment 17 — Communication device 19 — Various sensors 

21 — System control section 23 — Interface (I/F) 

25 — Voice input section 27 — Speech synthesis section 

29 — Appliance control interface (appliance control I/F) 

31 — Internet address database 33 — Reference control section 

35 — Dialog data-storage section L1-L23 — Dialog data 

37 — User profile storage section 

Ml — Input means M3 — Device M5 — Situation detection means 

M7 — Data-storage means for an activity setup D1 — Data for an activity setup 

D2 — 2nd data for an activity setup D3 — 3rd data for an activity setup 

D4 — 4th data for an activity setup M9 — Setting means 

M11 — Appliance control means Ml 3 — Demand presumption means 

Ml 5 — Individual information-storage means Ml 7 — Change means Ml 9 — Discernment means 
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[ Drawing 8. 
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[0 0 0 9] 1*5, m^M3 t LT(1. ^^<Dx— ^'■-i- 

Rxm^mmxh^xh&\f\ 
[0 0 10] ^tz. A±i^mMii)^^Afj-r^mmti.x 

tLTH. «SA;^J (o*i9. -ffiffl^iaJ^tllifi^JfcHt^SrA 

[00 11] ^;i-eit#{c. *i§pjro®mggfi, 
i>mi»tix\,^i>i^u^mm-r^^^m^mM5 1. » 

rt^S^fllT^-tJ'iett^^M 7 (dji, A;'3^SM 1 }C J; 

r^p^nn^m7'~-fDiimm^ixx\'^^o 

[0012] ^ LT, ^S^ISM 9 AtJ^^M 1 iz 

i%tz^m.tizn!t^-t:bmrfr^m^. mn5.W}^\Hmm^m 
5o •rsi:> «5gsijw^©Mi 1*5, mmwt^^^M9 

tt. Mftf^ (oil?, mSM3S^lilf^$-^^:/J^^^r t) t 
[0 0 13] :1CDJ; 5^<C*^?^roSlJ^»Slg^cJ;n(i, A 

ti^mMnzx'o Atj^titz^m^A-ib(riAtimmfzif 

X^ttj:<. ^m^tmA-tiX\^^^V^N,lZfSiCX. m^M 

^mz^^cx. timMs <DmYF!f^m^mm^£h<vi,z-th 
mx\ ^<Dmm^(D^mizB\ii.it«immf^i:mm-i>z 

[0014] l^\z^ 2 icfeiJwfiJ^WSgiltt. El 1 

izmm-t^ X 5 1 \zum<Dmmmm.izM l 

^Jt^^SMl 3»i. A;^#©M1 tcij; ►) A;^$tt7t1f 

i^ui^m^^M5izxr)mm^tirzVit>Lt. 

[0 0 15] ^LTMfc, idftt^^^Sffir^-^fSlg^ 
mM7iZtt^ At)^^MHZX<OAtl^tli>m^t. 
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[001 6 ] LT. Wf&^mu 9 tt, A;'3#^M 1 ic 
J:t)A;^^ixfc««t. ^^ft^W#J^M5{cJ;i9^^m$ 

t 5 s**i^^i^M 1 3 Id J; •) it^^nfcii* 

[ 0 0 1 7 ] 19 , W*]S 2 {CBS«a3$iJffiiS?aT-(l. 
^ffl**^^«A;^Jlf^i:, 4^iS,«IUi#ISM5{c:j;iJMttl 
^titiUfHilt, iSmmm^WtMi itc:J:5«SiM3<olb 

^L, •?•^0^i^Lfc{£ffl#(^g*^/^•7^-^5'<^loi: 
LT. a§§M3(D«j#(^^?rlS^-r5J: 5(c:ltv^-5o 
[0018lJ;oT. r<Dj;5 ?fcSt'*« 2 {C|5«<^*J«l 

^ 2 (Dmi^fHmn^m^—^ d 2 {±. isi^^^m 9 

^•T^-iJ'Dl, D2*»^|^^(cM'S2.i()f^rt^€raLffi 

tz. #7^-^ D 1 , D 2 (c:^^W«3fe)lSfiE5r^(tTi3 

1, D2(oio-fo*>e>i(>f^rt^*t^^LT. K^-rs 
[0019] jsfctc, 3 i,zmm<oMmmm-i. m 1 

fSti^SMl 5fc|HtS^?ix2)<@A1f«ir(^5 *>T% <BA 
til^fBtS^gM 1 5Jc:|5ttit$ix5fflA««Sr-&tf'><C< 

htz»<om3(Dmi¥fh^Wi&m7'-^ d 3 Asieis^ttT 

[0 0 2 0] ^:LT. ta::£#®M9«, A;^#®Mi(c: 

ix^t^^iai:, fl*:lt«^^Ml 3(cj;i9«^$ixfcS* 
®Alf ^IStS^SM 1 5Jcfalg$4xyS:eA1*aitO 

9 *>T-. mAmme.i&^mM 1 5 tciEti$ixfc®Ai^« 

i:. mmfS3<DmiiFfHmn-^mv'—f'D3A-hmmL. 



[0 0 2 1] roi 5?'<cf»*^3{cl5«cDffl^^Mfc:j: 

tid. ^m^mimmzi^^-r^mm^(DmAmm^.' 

1BA1t«ieit#SM 1 5 (ctett LT*J<:ii:(cj;t). ^ 
<o^ffl#<D^@A1^«-as^-«7^— ^'<Dioi:;t-oT. «^ 

[0 0 2 2] [Si, W)iPf>^^mm'f'-fDltm2(DW3 

f^rt^lS^fflT^'- ^ D 2 ^ 3 (^Ibf^l^^^^fflT'- ^ 
D3«, ^^^lfeM9yi5#x — 1, D2, D3*^^ 

6?)f-tS^LT*Jtt«SV\ ^■t'— ^'Dl, D-2. 

D3(;i<^^(D®5fe)lIfi=lr^(tT*5#. ^^^ISM9(i, 
^(^M5feWS^{-tSV\ ^■t'-^DI. D2, D 3(0 10 

fcl^,^.T% *©i!)f^l^^lr«I^M 3 (DWji^ff^m- 1 Lxm 

[0 0 2 3] mz. tt*:S4{cfa«(D$ijw^gtt, mi 

S J; 5 ic. 3 {c:|5«cO«iJ^»$gg(c*|-L 

M^^Ml 7(i. HulSll3tOS)f^F*>I^iS:^fflT'-^D3 
f@A<f ^lEIt^SM 1 5(Cf5tt^nfc<@A1f«lCj^:: 

[0024] rcoj;^ W*« 4 ;cfs«ro*msiet;i J; 

*iS4(:iiE«ro$ij^^S{c*5i,>r. mAmmmm.^^M 
1 5iza. ^wiiA^(omA^mi^^m^ti^x^\ztj:^ 

Tv^sis»A^><7D^@A+t®'7)^'*-?5, m£<D'^mm<r>m 

Ait^Sr^^-r^itSiJ^^M 1 9 Sr11;tTV^S„ 
[00 2 5] ^ UT, ^M^IJM 1 7 Hute^ 3 coft 
f^rt^lS^fflT'-^DSSr. SESU^SMl 9lc:J:!9#^ 
$tvfci@Ait«t:if£;i:T^ML. ^:^#^M9(i. HtriB 

m 3 (^Kif^l^^^^vST^'-^ D 3 3!i^P>ftf^rt^Sr«l^-r 
SBSIc, HulEittSiJ^i!:Ml 9(cJ;!J4$^$ix/cfflAif« 

[0 0 2 6] r«ff*«5(c|5«roSiJfflligM{dJ:n«> 
® Alt«IS1t#lfeM 1 5{cfflA1t«*i|Eit$nfc«IScA 

\zuwL<Dummmzi.i>^^^m>^ti)^-(;^i,o ^ 
iz^ tn^iS6iz^m.(ommmm-r^n. muzmm-r^x 
0 (d. m^m 1 5 ^zmwi(omm^m^zm'>x. 

»f^l*3«S!:3efflf'-^IE1g#SM7»cH. «8iL«|ffi#S 
MSfdJ; t)^ttti^ix-5tteiro;fAd*b, fiiSiM3<Ot!if^rt 
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[0 0 2 71 ^LT. fg^^SMstt, i^VLmm^mM 

f^l^SzPfctitf, -?:«l&f^(^^$r. ffilSMSOtdf^i^^ 
[00281 r(OJ:5 ?5rif 6 ic^HUff^mm^Wz. J; 

tt«s ffi^#/i5S;&»ixT V ^ i> Vim^mm<o:!ikm^ o tz 

[0 0 2 91 (S). M4(Oi(jf^l^^|$Sffl'7^-^'D4i:ftfe 

nWi'^^^WL'&m'f—'^' (Dl, D2, D3) 

fc. ^4<oi&f^rt^SS:^fflf'-:J'D4i:te<o«f^(^^Si 
Sfflx-^ (Dl, D2, D3) i: {c;g|^<D®$tJI|i^Sr 

[0 0 3 0] mz.. ft *^ 7 {Cl5«C»SiWSBT'(±. t» 

[00 3 1] Z.<DXb ^m^m 7 (C|5«cO$W^S{C<t 
*3 < ^•tt'f^F'gS^^fflT'- D 1 ~D 4 J; 

[003 2] 

[00 3 3] m2 \z7v^-rx. 0 {c, 2iciiJS?^^o®j®igE 
7 1. ^ncom^^m. m^m) (Difkm^^m.^mp^^of 



tz}ii(nm.7m.m.\ lir. :$:^^cD^il?r^^J^Bl•r■53:r = > 
S^Sl3i:. hT— -7° u=>-i?', CD (='V^s-^' 

hT^-i';^^') T'l^—- MD (5=7^ -c^^') •T'U— 

5 ;^^EDOV ICS (Vehicle Information and Comm 
unication System) <0;K:ielS6^-^s 4^-^^ — V b<0 

mmm-ux^^^-^^-^y Yim^^h(DWiX'im.\z. 
J; ►) r-'fmm^ff o mmmw: 17 Mm-^Mm^ 

[0 0 3 4] iSj, -^-t-y— v'g ^^i^figjl, 

SrlEtiLfcCD-ROM, -?:<^CD-ROMA^ib-r— ^ 
S:SE^W-rfcfe«CD-ROM K7-<:^. ^tt/:, 
*sii<^S:A;'3t-5fcJ?>«oaif^dE~7SifSriii;tTV>5o ^ 

LT. -^t'>5^-->3>-$^e9(i. m^it. mm^A^i^m 
-rsji^t^dSAyj^ixsi:. ^m(Dm.^iiLm.i:B^m-^ 

{::«^$■frTSI&^^*3^^T5„ ^/i^^S l lie: 

i/t'ci^— K(c^^$ix5 ^<75:^-X'<-;*-gBl .5 
{-■(1 X ?)iX7t 7^ ^ — :h{c J; §:ft $ ix/cT^ w- if <0 

[0 0 3 5] ^LT, mm^mm. cpu, rom. 

S.O'R AM/£ ir" ^' n = V — ?r f ,L>{c: 
«^$tlfcv'^-7"A^JtBl^2 1 'yy^y-h^ymU2 1 

A:^^fi 3 cDJi^^x — ^Xfi-t ^'i^y^yzz. 
—y^ (i/F) 2 3i:, -v^^r D7*i^5*»e>A;'3$ix 

2 1 lcA;^;-r^il^^A;^a5 2 St. v'>^xA$iJta|gB2 1 

^jfeUT>^e-;<7 7tcfcb;^L, :^ f-* 7 Sri!i»)$-fr5 
^^^fi£Sl32 7 t, ±E^fy— >3>^e9, 
Bl 1, ^T = v^ei 3, ^-T^WJfSBl 5. ii« ■ 
S^S17, #a-feV-!M9, XVte<?5fWS?Si:->:^x 
ASimg5 2 1 i:^x-^ii«^|g(c^ig1-'5«l5gftiJfflH' 
(HS^mi/F) 2 9 t*«|x.TV>So 
[0 0 3 61 ifc, ^J^iS^aucji, amSgBl 7Jc:j; 

3ii:, ^nvmuz "i tiim^hi\.x\,^i,^ ^lx. 
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ffiiffl52 i*^e><^ji^(c:j;oTi5itstL, mmm%3 3 

T Vyy^'f^^^—T. 3 1 ;^is^ hr ku-:^ 

I0 0 3 7J f^, if-%'Smm-^\t. :^\f-fn , -^t'y 
— 3 ^'S^g 9 , t-y— > 3 :x|gS 9 tc'dx. 
fcCD-ROMK^'f:?' , g^i^ei 1, 

^Tn^-igglS, ^-7'w';*-^gl 5, afa^gl 

[0 0 3 8] ^ LTMfd, fdiW^a 1 J-tt. ^ t°-:* 7 
01^^ (iPt>, ;^ t°— ;*7 7 0S)f^t^^) t^f— 7 4J4 

ifyD7r'</HB1«?fl5 3 7 i:^#^TV^5o i^, :L<Dn 

iST'-i?istigi5 3 ssr/^.— r:^n7T-r>'H2tigi5 3 7 

i:^ flSiBL-fcf ^s/ hT KW^^f'-^^— ;^3 1 
fE- y (C i o T«^£ $ iXT u ^ 

(0 0 3 91 :irT% *MSx-^IHtta5 3 SlClEtft^tl- 
S^flgx-^'-i-^^i:, ^— »Pyn7r'1'/H5lSSl5 3 7 

3— if7'n7r'r>'HE1iSB3 7{c|Bt8$^^^^iIA 
'^^h\.x<r)=^—^-fuyr'if^\t. mxMS&.T<r> (P 
-1) ~ (P-i 1) /£i?©#«etc:ov^T, tt^^tc 

10 0 4 01 (P-l) : ^(DA(^5>« (-fiS, thS, 

(P-2) rftiS. ^roA^rSagiJ-rSfcfe 

^) . 

(P-3) : B (M^B) o 

[004 11 (P-4) : W#Sfio 
(P-5) -mxo 
(P-6) :Ji®^ 



(P-7) leftist 
[0 04 21 (P-8) ra^fe, 
(P-9) : «*(^S6<]T% J;<fi^< t w5c 
(P-10) : M!fe©i6<]T. J;<^T< 
(P-11) wm<r>^^, -&Xf-WSk<n>^'^ 

M Bo 

[0 0 4 31 C<D3.— if7'n:7r'</Kl. 
A;'3^gg 3 5ra^^ LT±!E#9 i cOf^m^Xtli-^ r t 

^2 ico»#3i^S]f^(cj;oTiatt$*x^„ *ffS 

'B»ISrS4~|218(C;^1-J;p(c. ^fl^^Wf^-^^at 
Sr*LTV''5o -tLT, E4~EI8 {c*ju>-C,-igl:i^|Rl(0 

^iXTV^So (Si, 04~El8T-tt, VL1~L23 ii 

2®{;ll:oT*$j^TV^S„ 

[0 0 4 41 iP*>, ^ffSx-^-^-^^rlSfiJc-t-S^-^tfg 
^25'n7*V5S.Of^:^A;'3?^B2 5 ^:ft-l.XKtl^tt?> 

[0 0 4 51 ^r-c, r p Lfc»ISx-^'<-;^<^#« 
(C-1) 

[0 0 4 61 ^LT, Z(o r^mi ^DJSS^::fBig^i^S 

rt^^LTii, m^i-i. i2i4~ia8tc:«rij^-r5A ptc, 

filgs, SKSgf^, i|^l5g, H 



(7) 



#M¥11-351901 



[004 7] (C-2) -.mm 

r^iBj cD^gfctt, m, K, ^-irv^ofczg^cofsj 
(C-3) :^ffi»s^^^ttB^ 

r^W^^vMSB^j ro^sjcfi. ii, m, -P-ffl, 

[0 0 4 8] ^-LT. r<75 rffiJ^^^^VN{i BffiJj CD^g 
2 ljiSF*3?^4:i^»:IBxSi--5<>Oi::dSj,5„ m^ti. H4 

[004 9] (C-4) -.S^m 

[0 0 5 0] -^LT, ^<D r@6<ji|6j tOJggtt, |^^;i5 

m5\zm7Pi-^y-^ >-U2 , L13 (D^J-fg-T^— ^ 

VL12 , L13 }i(^1-0>I^IS-r-^(C*iV^T. rg&<] 
[0 0 5 1] (C-5) : 

[0 0 5 2] i 1.x, z<D ^^tEm <Dms a. rg^fj 

O^g rt^^dJIEiE^tlStOtlEig^iX 
~L13 cd^J-ISt'— ^^c*3l,^T. r^iteifij co:Sgic:*D(t 
tm^^i^i), S4~lll8(cfiSJ^i-^>±|E7'f'>' 

Lii ~Li3 Jei^<D*^i^•7^-^'^c:te^^T, r^^tttsj <d« 

[0 0 5 3] (C-6) :mm 



^m-Tfhm- (mmMm, -:i^mn, mAm±f£t') . r 

[0 0 5 4] (C-7) 

m (Bfix, St), /hpi, m, ±m, m, m, -^m^i 

f) . g«)lfeo?c^$r«f F*3^ St). /J^Pi, 

mm, •'^'^M, -rt^Tv^s, ^^^^tj:tn . r 

Mmmm^u^m-tP^^ (jiv^Sb^Mfct), ii^s 

So f*lv *W^3a4^SE.Sr«-ri^^i: LTI4, 

S:#;!)P LTlEig LT*J < i t T- 1 •So 
[0 0 5 51 (C-8) :*:rt4^i£ 

:^-^<-f£b') , ^WHi^r^-ri^^ (lA, 2 A, A 
(Dm-^iXi)^&-r>X^^^t^t\>^onWiP^^fiif) . 
MXtcDh'y-fy'. JS.AiKDv'-hfiif) . R 

[0 0 5 6] (C-9) : 

mm, h'y-^y', i^m, i&rj, ^h, mmm, 

J5^, dt/uy, di/vy^^m, 

taSS: Jiffs, :nr = i^Sf^:T:||/fei:% 
fSifi^tfCv^So 
[005 7] (C-10) 

ipi: LTv^s^*llg) , 'Ria. m^^^^ 
"^mmn^, Tun-mn^p, mm, m^, m<otc\,\ m 

V^S, ^oTV'>S, ^*sttA/TV'>S («*>iiA/-ev^S) 
Jfeif, i:V^ofcrt^/S5fS3$$ixTVNS„ 

[0 0 5 8] (C-1 1) : 1@A^f« 

r®Alf#J «D«g{CU4, fujSLfc^— tfyn^T-T/W 
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<r>^3S.B (P-i~P-ii) (Dt>^x\ ^<r>n^— 

[0 0 5 9] ^LT, Cro r^axit^J <D^Si:bT 

— !f^n7r-r/K^ (P-1 1 (O^SSJC^f 

(P-8 CD^SlcmUfci^.^ (rcO^ajT- 

[0 0 6 0] rttl-*rLT, m^\-f. E6tc:«»J^1-57 

n7ri'/KO (P- 1 0 : Mitfeco@6<JT% i<fi^<t:i 

h) ;!lS|23^g$^^So 6 {C^aj^^-f-^ :/L18 (D 

>ff|g■r-^5'tc*^v^T. r^gAlf^j ro^g lc*J(t-5[]rt 
ten, '>^T-AS!||WaJ2 Ifcit), J.—- tf:7'n7T-<>'i' 

(P - 9 : S*co@WT-. J;<^f < 
IEig$^L/crt^ ClOfiai-Ctt, D=J/uym) imi&^ti 

[0 0 6 1] OS f), ±f57'r>'L16 , L18 fjSAlt 

«|5 2 Itt, ±|E^i^x-^^cS-:JV^T. r®A1f «J © 

^B(ci3(tS[]F*=I(c:, ^^.-f-'ycr^T-r/K^l^^^rlEKg 
^■•SJ: ^ idT'ioTV^So ioT. ±fE7'f'VL16, L18 

7^c:5IBg{c|Btg$i^fc^— if7'n7T'f/i'{c 
[0 0 6 2] i^. ±127-1' VLIS ro*)-fS7'— ^'{CiJCj-S 

(C- 1 2) : ^-if^fg 

=t-!7-hW. ^^«'JW3SBl<^^^l&«t''ioTV^ 
[0 0 6 3] au. E5lc«SJ^-r •5 7-1'^'Lll cOMKr" 



[006 4] (C-13) :«lf^rt^ 

ribftrt^J ro^BtCll. ^^*im^e 1 2)S*S«M 3 

— ±IE (C-1) ~ (C-12) ro#JfiS(C|E 

[006 5] ««Jx.tf . m 5 tC'0Ml:^-rs ^f' ^'igo^ffSx 
^i^lS9^c:'li;tfJ^^/cCD-ROM K7'f':/^v>ttiifa 

r:}3A*T-riao r <Oiff< P>«<a >, <b>, <c>!tei:* 
<X1 >#c7)*50^5fcl9S-f-, t' :LX''k^^-tA\ J tv^ 
7 31— :^ 3; V h^lgSrffl;'^ ir^^ofc«I^M3<;D 

[0 0 6 6] ifc^iJxJi, lll5{C0iJ;^-r'5 7'f'>LlO <D 
D-ROM K^'fy^l/^ttafti^gl 7{C, ^^EJte75>e> 

*7*»e> ^<d>/^•— ^^ri^^Jiy fci:<X2 >5J-. 2fc 

[0 0 6 7] SifeMJc, •esj;i{i. mrizmTp-i-iyy-i:^ 
L19 ro^^|•Ig•r-^{c:*J^^T. rDjf^f*3^j OJSi(c«, 

mtl^-^i>tmiz^ aira^-SSl 3fC*^l^<DjaSSr 
Tff^-BrS, tv^ofcttt«M3ro|!)f^rt^j»Si^je)|5ig$ 

[0 0 6 8] i^, 0 5&t;!@6^cfc^^T. ribf^rt^j 

a, b, c, f, XVOO u-:^ h 5 «lsS$ixfcu 
;^b7>'iS. d. e«i|^5i5SixyS:'<— ^i^^^aiyriS, 
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1 *»p)X5 *t><ox-e*6*siE-§-«;, mmmmz^-^x 

■ Bfil^ffl**-f^tt, X4 , X5 tt«lst$jX7tU-:=^ h7 
(0 0 6 9] riijf^F*3^j co:a@i: LTfi. 

^fB 3 7 (cn^tciaii $ ttfc^— if 7 r /W{CJE£: CT 
fe-5o ■««J;t{i, lll6{Cfisj:^-t-57'l'>'L16 O^MSt'— 
;^7^,/^*J^Sl5 2 licit), 3.— f-Vn^T'f /KO (P- 

1 o : w!^(oB^x\ x<n< tz.^) nm^izmm^ 

ixfcrt^ (^cD«aj-cti. AT^^^°-^) iiS|Big$ti.5o * 
-t, E6(C«»j^-t-5 7-r XL18 <0*|-|S7='— ;J'tC:*3U>T, 

2l\z.i:K). =L—^-:fuyr4>v(D (P-9 :jit5fewa 

[00 701 oil?, ilE^-f ^-Lie , L18 CD r»jf^|*i 
5 *5 T'Hixoii i (c|2sg $ tLfc rt^ 5r [] F'g lExE-r S <o 

plc/^oTV^^So J;oT, ±fE7-rVL16 , LIS 
[0 0 7 1] *^itce<jmMi-5i:, ®6{C«5|;^i-57'r 

flOO (fi^j^««:§gfflp°B) «o^<-yv$r^oT*-r. J 
7i5„ 1116 (;i«ri|;^-r5 7-Y>'Ll8 CO rgdf^F^^j 

[0 0 7 2] (c-14) -.mmm^ 

^a;45^ ^i^m.<oms (C-2~ 

C-8) icfEi^tfc^Sitc/iSir^jc. -^ffl^ds, ^(O 

mmv'—S' izioif ^ ToL— if^ggj (D^g (c-12) 



^tciift^ rtftf^l^^j (C-13) {CfSi&UTt 

[0 0 7 3] ^LT. r<o rft^^*j (^^gicieifi^ 
ti^\H^<D^<v :i^—'>3i^ mm) it. MiSLfc 

(c- 1 5) : m-^m 

^(C*J(t-5^iff.0^i (C-2~C-8) iClEi&L/t^^ 

r^.-- (f^lgj (75^@ (C-12) {cfEi^^ixfc^— 7 
(o^e (C-13) (^faiELfca^l^Jf^:^s^^^c:^T 

[0 0 7 41 ^UT, r<D r^t^:ytlij cD«@{ClSig$ 
tt^l^^Oz-^y^i— >3>'tt, HuiELTt r^btffij <o:Sg 

(C - 1 6) : li^MiiS* 

[0 0 7 51 -eLT. ^(Ti m-&m^miK\ OJSSfClE 

iJi'^T, |g|4~iii8(c^-rj;^(c, r5j-5ij rgjjf^i^ 
i:a>2o<?3:^gjcoi,>Ttt, t^TWjI^IS'r— ^fcf^ 

*5i2iKE^H/£V^»-^'bfcS„ 0419, |lj4~Bl8(C*3(t 
[00 7 61 £X±<OX 0 \zm^^Mz.if.nW^ 

->;^xA$iweB2 iji. iT^xs/T" (£AT, rsj t 

15-r) llOICT, A:^^B3^tVI/F2 3t-=r^'^' 
-A;^^v^Ji^^i: LTA;'3$ixS^ffi<D^ffl« (■=!•- 
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[0 0 7 7] ^LT. M< S 1 2 OfdX. ^— tfT'n^ 

^ n7r-r/Kiottid^e,. WiELfc«i (P-2) {clEi*^ 
IxTV^Sf^^ (fi:^^ftfe<^ltSiJ<f^) t±i2S 1 1 OT- 

[0 0 7 8] -^rLrMtC. ig< S 1 3 0 ICT. ±fE-'<s' 

— ^^co^^T;. -troJt^T^— ^(CS<5#, ±|E/-5y7r 

L16 , L18 (D>!^|g7='-^{Ct5ltS r<@A1t«J t 
[0 0 7 9] SfcMtC, ^(^S 1 3 Ot?tt, At]'&S3 

Wom^^o OS'S. *^lS?i^ffiroMSB 1 Tli. S 

mmmi<D^m±(D^^ {am) ■ffiffl#*^t>ofi^ 

tcjt£;CT. 'B»l;ttf, -fStA, tt*. S:A, ico^ 
v^So i^^ Iil4~|ll8{c«a|*-r5^— h%fS(7?F*3 

So 

[0 0 8 0] A$iJ^»^ 2 Hi, S 1 4 0 ic 

t. mig-rSS 2 2 Oti^(D*n,S(CJ; i9*tfg7^-^-<- 

x-i^fcs-^t, ^^EOB^ (¥, B, ^*J) ^eg 

[0 08 1] •>;^T•i^$lJ^^?gi5 2 Itt, Z<DS14 

fi, HSJc^si^-t-ST-r vLllco^ffg^— ^) (c-ou^ 
[0 0 8 2] ^LT, S 1 5 OICT. <:^<oaffi«6 



[0 0 8 3] ->;^xA$J^a5 2 1 tt, cos 1 5 

(C, ~>;^xi=^fM^2 1 (1, rcDSlSOiCT, BuiSL 

^flSr'— (^HlfeJ^llfi-Cll. lastdfiSJ^i-S^-YVLl 
1 ~L13 conmy—'^) {ro^^-C, -?r<0 r^^jfij (o:® 

[0084] JSkfC, AftlJffllSB 2 Itt, «g< S 1 6 

[0 0 8 5] D-*/w/c;dSfe¥BBffi$ix 

^LT. iBg<S170(-T, ^t-fgy"— ^ ?r 

S7^^^Ll~L6<0>!^Igx— ^) (Oifd^b, ±123 14.0 
RXfS 1 5 0(^«ia{CJ:oT±IS^^-;/7rli*Sl-BEtt^ 
tl.fc^tU*g* (*65, ^rem-^B^, ^ffiSS) 
i:, S^i6f5S2 0 0O4!i.atc:J:>5^ai$jxT±IE^^y 

f*3^<;?x=¥;^ hx— ^S:^^-g-figS5 2 7 {cai;^LT. ^ 
f-;«7 7;5^e, rjjji J: 9 r^v>S-rj r-A.(;it,*3j 

[0 0 8 6]^Jx.tf, ±I2S 1 4 OT-lttfcJ^ixfcaffiro 
^*j3i5, 4^^^ib 1 l^*-C\OFBl-efcn»i, El4{Cfi«J;^' 
-r?.7'('i^Liro*fiS7'-^;4S;^m$iXT, :^y^-i37t^ 

TfcSo ^tz. ±fss 1 4 ox-mm^titzm^(DmMiK 

1 l^7i»e>l 8f^t.X'<Dmxi>tHi, ^4\:im^-tiy 
-ounm^y'-f'iimm^lrix. ;^e-*7d>p, r- 

[0 0 8 7] fSj, rroS 1 7 0<0jjeg!%ISO^h»<^)40!g 
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tzm^ (S 1 8 0 : NO) tCJi, S 1 9 0 {CjtA/T\ ± 

(%|g^-!7-K) Srttm-r-5i:*{:i, •?:<^>tttHbfc^ 

<Sr^T5. -^rUT, ^om, S 2 00(ciStfo 
[0088] ifc. ±I5S 1 8 0 -Ctl^ife^jJS-^g^m 
SA-ttdSoXi^LfctflJSLTt^-a- (S 1 8 0 : YE 
S) ±fE^<-;/7r^«(c:, m'S- (^l/Mi. 

^) J i:v^5rt^*l5«Ls -^-cD^. S2 00lcittPo 

LT. S 2 O 0 Xtt> -K^^^SBA^iXTV^S jlSg<04^t 
ift (H^tH.) (D0hX\ ±ISS 1 4 0S.U=S 1 5 0X1^ 

10 0 8 9] rrx, S 2 0 0 O^LaXtt. MtSf—^' 

K^. ^ffi*^f^'roaII&*s-;brii^fT•*)5^:*»itA^Jt 
'ikm.t<D^^i-i. vicstt# (V I csroSJci^^^*^ 

10 0 9 0] * fc, ^MfVUkm CO 5 *>T% la^ifi&tJf 
(BSix. «9, /hPB, H, S, H, 

V 1 C sm$B§rii{tgg 1 7 T-S:«-r5 w i: (c J; U 
V-tM 9 (D 9 *><0?S?S-tr >-^(Dm^f)^hi^m-r^ r 1 1 

[00 9 1] r<:(*3^taj 5 *>-c\ ^p^iaso 
m^mt. ^-a-fexf- 1 9(0 9*,<oia^ir>-9-A»f>co« 



pco^Mm (lA, 2 A. 3Ai!^i±) i:V^oAc«*:4^ffi 
[009 2] ^ bX, r»(*3:|^i5£j <7) p *,-C% Sfe^^ 

(8^?SLfciis&-e(o^^T, ^stS'fei^^T, mmhK)t£t') 

-^s (m®e»ix, t*wffi^fcif(^«/iA;dSffio 

7, ^a-lr^'IM 9, &U«flfecD$iJW^B/j:i:'d^bcDtt« 

s/-fe— v={:ij: Rg^^-g•t>-^i-T. 
[009 3] i^^f" A$fj^ttlF5 2 i tt, s 2 i o ic 

^tT5o r::T-, s 2 1 0 cDMat?(i, *J-Sx— 

;^©tt'd^P>, ^Sg-rSS 2 7 OS-U^S 2 8 OcDHudliD^Q; 

s/^rffli^lclElti-So 

[0 0 9 4] CWfcto, S 2 1 0 (0«!!S?ri!il-x.:fc^^JC 
#(0^-ify^7T-r/^ (fflA1f#) ir. -ffiffl^-iSlgiS 

irir/iSo 

[0 0 9 5] ^CT, v';^7"A$iJ^gI5 2 1 tt, igc< S 2 

Si co-T y f^i^^^Sri^tt-rSo 
[0 6 9 6] *flE6<j{cii. •(£ffl#AS|||[Rtc|g|gUfc^- 
17- Kir. *ffSx-^'C0 r^.— r^lgj (0«gfcfB3£$ 
i^X\^^^^-U-Yt<D-7y^>ir. ■(£ffl#OS*Sr*i 
^LfcrtSi:. *flgx-^'<0 rs*j <o:^g{cfBa$n 

Si:, *fST^— r^^fllj co^gfdfEizE^nrv^srt 
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[0 0 9 7] rcOS 2 2 0-Cli. #tc, *fiSx— 

T, -hlE/-<s/7TlM«JcfEt6$ixTV^5l^Si:-iS:-f-'5 
[00 9 8] ^ LTXlC, S 2 2 0 ro^lLSt?^. #*f|g 

-i'^rn^ (iP*>. Bl4~|i!8(c:7j^f-7'i':/L w#-§-) 

[0 0 9 9] ^-LT. i05< S 2 3 0(CT. ±1ES 2 2 0 

'Oi,izt<t£ntH-£. HUxELfcS 1 9 O^V^«S 2 0 0 
2 4 0 (Cl^^T-rSo 

[0100] ^LT, C»S 240{CT. ^J£LTV>5 

t±i;'3 LT, ^(D^. S 1 8 0 (cM5o -rS) t . S 1 8 0 
~S 2 2 0(^«!.S;6SSO:firt>n5r t ir/iSiiS, wCDj; 
5 ICS 2 4 0 rotoaic J;Sffiffl#->OPo^V>-g-*3-&*s=fT*P 
ixfcii-g-Jctt, s 2 2 o-ctt, JilE#^li«tlC7'i' 

lO 1 0 ll t.1t. ±15S 2 3 OfCT. ±1ES 2 2 Ot? 
■g-dd, S 2 5 0 icmtSo r (/5 S 2 5 0 Tfi. ±fH#^ 

2)t*iJ»fL.-C. S 2 6 0 (c^-T'S. 
[0 1 0 2 J JErLT, rroS 2 6 0(CT, ±f5lg»^@ro 



s 1 8 o~s 2 2 0(r>^mA^wxmt>fii>:iktfi^ 

i:>'^1)mt>iXf^m^\^h\ S 2 2 0T-(i, ±IB!t#^ffl^ 

[0103] ±ies 2 5 0 T'^^*lJS$ixfc« 

1 s 2 7 0 dilAz-C, IfffifitTJSft 

(0»lf^l*3^t UTRAMP^tCtai^-f So ^LT, )gg< S 
2 8 OtCT, -hlES 2 7 O -e^^$iXfcSjf^F«9^lCt^o 

«SM3^1&f^$-fr5c 
[01041 -oi t), S220~S280 (OAQjax-fi. 

S icIEiE ^ ixtz (^^*s±fH/< ?/ ;7 r ®*iE{::fStS ^ ti 
TV^-Srt^ (■Kffl*;d5g*^ixTV^5*«^Sr«-ri*3^, 

«(;iti£oT. ^t-;<7 7Sri&«)i1-5SIS§M3Sr»f^$ 
[01051 ^ bX. S 2 9 0 {CilA/-t?. iSfeffl 

tn&Lfzm^ia-i. s 1 4 o^m^AK mmt>mTL 
[01061 ^i^. sx±<Dx o fivm'^m i <Di^mizr> 

ofc^Sr— y— KSr^lg-rSt, S 2 2 0~S 2 8 OCO40- 
3atC i , E 5 (Cfiaj^-t- S 7 -f VL90*f ISt^- Tbmn 
^tlX. -5:<0*riS^-^ (L9) CD riiif^i^^j (omSiC 

mji^^ntz\Hm*m§^M3(DW}i¥f^^t lt^s^h 
■So "to^mm. ■r\fy—u3>'mm.9(DCB-ROM]f 

iSo ::cOifi< ''cC^tf<a>, <b>, <c>t£t'<Xl >#<o*j 

[0 10 71 Civlc*fL. *M*5ig5SatSS^ife=ff LTV^ 
-Kffl^ds "feL" "rig" t^^ofc^-y- 
KSr^lSfSiix S 2 2 0~S 2 8 0 WiaaiCj: g| 



(13) 



#§g¥l 1-351901 



<DM^'f-i' (LIO ) <D riiif^F*3^J (DmSizmm^th 
Tii^^m^tlX. :^\^~l3 7t^h r<d 

[0108] c (D i 5 tc. :^mmmm(ommmm. i x- 
xh-oxh. ^m^*mA^tix\^^^-^mzit-\:.x. mm 

[0 10 91 — 'ea|;t«*M*5S»» • xiJiS^rtJ©-® 

L" , WK)|sfa" tv^5 aocD^-y-K^Sr^e-f- 
St. S 2 2 0~S 2 8 OO^aStCj; 9. SI 5 (C^ilS^-f- 
^y-OLll <D^U'f-'$'1)^mSi^i\^X. ^(DMmv"— 

«17{Cj;f9. ^>'^-:^^y hfii^fi^h. S*P» • fSBW? 

f (D^m^mmmtA^i^m^tix. 7A^h r< 

X4 >^<X5 >5>(c:. <f >z)5^^T't*-r„ J 

iSx-^^::^3^^T. r^ftjfij ro^sstrfi, ^n^x<o 
SI 5 0(^4!!,g(cj: l9<xlJ;S:>^JS|Eig$i^r^^S„ 
'[0 110] ^LT, r 5 LX±ni^^ :^in (DMMt^ 
— ^'j>s»*i$Hfc«-^{cfi, j!fe<DS 2 1 oro^aatcij; 
t). 7'rvLii <DM^v'-f'co rjt^g^j t rii^M 

Lli <D>Ptfg-7^-^o rjt^4^^ij ro3lg^r|E56$^^-C^^ 

ilE^-* ?/ r ««J-12tg $ its o 
[0111] :L<r>fz.\h^ ±IE7-i'>'Lii rojttfg-T'— 

J^;^LJifttHi. !!fc03S 2 2 0~S 2 8 0(O«!;S»c:J; 
•3. ®5{c:0i|^-rS7^XLi2 <o*fS§-r— (fiP*>, 

^) *sil^$ix-c. ^<Dn^¥—'9 (L12 ) <o rsif^rt 



TS:t$jx5, ^-iDife;^. iiftilgl 7{cJ:!J, VIC 

t r^fiifij ttc^s-Jigtciid:, ii:sfi(7) s 1 5 0 oftisjc 

[0 1 1 21 ^fcXIC, r 5 bT±IB7'<'VL12 <?5*Hi 
f—9iP''WSi.^Mz.^^\::.\t.. »:©S 2 1 OrotoSiCi 

[0 1131 rrofcfc. ±15^-1' VL12 (D*J-fgx — ^J'tC 

J^;^L/i{ttu«, 2);«S 2 2 0~S 2 8 OWS&SlcJ; 
(5. B15{Cfi»JS%-f- S^-f VL13 (^5*)-ig7^— ^ (iP*>, 

:i^T. ^(Dn^'f—^ (L13 ) (O riijf^rt^j 
ISa.^ixfcf^S:as«SgM3<7Dliif^rt^i: LT^^Stv 
■5„ -^-cO^m. iiftSSl 7(CJ;I9. VI CSiW^T'iif 

Mil^rfT) '^=fT< fc*<D±S'SjlSSh, i i:, -^rWiiiSS 
h, \<r>^miikUbif>i^m^f^x. :^f-*7d»e> r< 

h>li^l^iLTV^Si-<75T•< i >T-fT< :i t Sr^JtS*:) 

bB7^^^li3 cDSsriST^-^tcijVNT, rg6<jisj i 
^EK6j t ro#9 B Id tt, iEMo? S 1 5 0 (D^aSJC i U , 

[0 114] — M3$Lfc7-1':^L9(;5*tlgf'-^;i5il 

M«g^cf5il$^^T^^5f*^^ (:t:», tJ: 
ifi. mm^<Dm-&^ti^m^tL.X±M'^<y7r 
fB«c(ciHlg$tb5i:*{c. 7-r:^L9<o*Hi§v^— ^cD rji 

So 

[0 115] r<75fcft, «3J^«, ±157-1' >'L9ro*f|g7' 

«>S 2 2 0~S2 8 003«!;atC±i9, S6»C«aj^-r57 

-fVLH ro*fBx-^ (EP*>, rS«j (Di^gfC "-IS 
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^) im^^tir. 't<Dnmy'-'$' (L14 ) (D riijf^f^ 

■ xm^^iii>, ^nm^. miBmm.1 Tjciu. 

[0 116] fi^!)x(4\ ^f^t;:A:i5^oru^.5i:* 

fc, *:^|^©jaS;4530'CJii±T-*> 19 . L*^"b, S2 10 

t?/Jc^^^g■g•fctt, S22o~S28 ooj^astc 

iXT, ^CD5tttS-r— (L20 ) <D rgftf^rt^j (D^gtr 
n'&m.S'kTlf^-t:A\ J i:V'>5rav'')6»lt®ji— i?3l>' 
[0 118] ^(DtL^b. ±IE7'1'>-L20 (DJ^ISt"— 

iSt'-SjJN S!ijc£:^T?fe5 1, s 2 2 o~s 2 8 ooiaa 

^ttX, ^W>t!f|g-r— ^ (L22 ) (D rftf^i^^j (O^g 

to 1 1 9] iiX{C*fLT. ±fE7'r>L20 (D*f|ST'- 

t\^^o^-Z7-h'i:mm-ri>t. S 2 2 0^82 8 
0(^«iSt::j;i9, ®8{::«r!)*-r.5 7'l' >L23 Wji^fg-r- 
^t>m^^tlX^ ^(On^f—f (L23 ) CO ritif^i^ 

ir^fc, ^T=";^$gei 3jJs*^rt<oia|gS:li3^-r-5J; 



[0 12 0] ifc, fiSJx.tfs *:^F^cota^;6520t:W±T- 

o^—u—v^^m-t^t. s 2 2 o~s 2 8 0(??Ma 

tCit). 0 7(Cfiaj^-r57'1'>-L21 (OjPtlgT'— 
$tLT, ^0*riSx— (L21 ) ridf^rt^j (DJgg 
»c?a3S$nfcrt^;i5«||M3«iiif^(^«i: LT^^^tL 

5o ^O^;^. HiIi£Lfc7'r>L20 tOjPtiST'— ^jJSiitR 

[0 12 1] ^LT. ^ 9 LX±m=7-f>l21 (OMtSv' 

[0 12 2] Z.(Ofzif>. ±|E7-Y>'L21 tO^ffST'- iS' 

iv^ofc:^^-!?- K^^fS-rtv«. S2 
2 0~S 2 8 0<?5*!!!S{c:J; t). mxKLtzy^ ^122 (DM 

^" tV^ofc=3r-17- K^^lSi-tll^. S 2 2 0~S2 
8 O<D40!atcj: 19 , BUx£L7tv'r>'L23 co>cJ-|gx— jJS 

[ 0 1 2 3 ] OS . :^mmmm<Dmmmm. 1 -en, s 

^5*iS$tt-5Ci: tifeSo -^-LT. S 2 2 0~S280 

ro«is{-j;'9. s 2 1 o(Dmmxm&^titzw^i: m 
i^. s 2 1 oo^tgicr. ^ffi#*-f,<7)^^cD^fgit— 

/iM4. mM(D S 2 8 0 <^*a;S(c J; t) tiSiM 3 ^WsfP^-t 
[0 12 4] ioT, 2|cj|JS?l^ljiroftij^$geucJ;n 

Sr^lSi-Si:. S 2 2 0~S 2 8 Oroiaaicj; 19 , B|6 
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Mmy'~'{' (LIS ) <D r®,f^(*j^j ro^gfcisiE^ixfc 
T-Lfc:?>. < j >i:<k>}4sa<{Cfci3Si-„ j ^ri^poi- 

») *^ ^m^(Dm-^^fi^m:^ti.x±^y<y7 rm 

[0 12 6] :i(otztb. ±my4:yu5 <DM^-f~^iz 

05teffl#cD3.— if^T-n^T-f >'KO^@' (P-10 : Kife 

"A'fy<-- h" r'fetT.tf, ii)C<r?S 220~S280 CO^O; 
SfCif?, lll6{c:^!);T%-r§7-r ^'Lie CD*J-|gy^— ^'dSjl 

[0 12 7] IP*,, ^^FBm^v^rt:0K^J o^igtc "9 

^*»t>2 1^" ;!)5|5xE^ix. r^^j co:a@(c 

Mi (omsiz "^mcomm" t'^ts.m^ti. mAmni 
(DIM a {w " Ax^N- h i < < " jjsfEiE $ ti. r^- 

t'-^ (L16 ) A^mi^ixx. ^(r>nm¥—^ die ) 

f, FAt'X- HT'-r*3i„ ^B«00 (^!lx.li«Sfflp"p) 

rtfcn, s 1 3 0 ct "5 , m&<oi^m^\z.mM<r) 

"At'/-?- h" ;iS|EsE$tLTV^.5o v 

[0 12 8] ■fiwjxtf. "C 
lij" , "^dr— " 2ocD^— !7— K^r^lSL. L 

^<r)'^f?i^(0:^—^-:fviyr-ifV(D^n (P- 

S2 20~S 2 80<D«!;a(Cj:i9, El 6 
(L17 ) (D riftf^rt^j (OJSSlClEiE^tVfcl^^TjsmSS 



-> 3 v^a 9 id ± s ^ffiAfi/!i=> e> c gj:x dr— ii--<os8Sit 

[012 91 fisj;?:^, ffiffi#2)s "=f/w:7*' , 
— rrn^T'f/WOD^SS (P-9 :j@*(^g6fj-e. J:< 

feixt^. s 2 2 o~s 2 8 0 coiaafci 19 , meizm^ 
•ti>y4>ii8 <DmiS'f—:$'t)m^^tix. .^nn^f 

— ^ (LIS ) <0 mV^^mi (^^BfdlEiSStb/b 1*9^*5 

y-o-us (Dnm¥—^\z^\>^x. r^BAlt^j t rgjj 

f^rt^J tCO#«@(Cl*J(tS[]F^(C{i, S130(D*!IS 

[0130] c (o<t p {c, :^mmmm<DMmmm i r- 

<?5«ffl#«)3.— !f 7*0 7 r /I'tcjEE: Cfc^liM 3 Wftf^ 

[0 13 1]. ^-if:7°n7r'l'>'HE«aJ3 7fc 

SI 1 0 ~ S 1 3 0 (Dfilkm\ZX 0 , ^ftO'^ffl^W^-- 

yr^Mzm-ti-^iei^y'—^^m^LX. ^(Dnwf 

[0 13 2] io-C, ^— ifT^n^T'fv'HSlgaSS 7 

Ads, ^^mmmmii:^mLxh. -e<oAS(c«i§gM 

jBffi«SJ:#LT40t:£t±IC/i5i:> S 2 2 0~S280 

<^*QiS{cj;i3, m7izm^-rzy-f'-yii9 <om^~^ 

^m^^tiX. ^(DM^y'-'f' (L19 ) <r> rgjif^rt^j 
w^i{c:iEj£E$ix7trt^j)s«^M3«;5»f^l^^i L-TS 
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[0133] o . ^n-mnm<DMmmmi i t-«. m 
10 13 4] iii±Pi&Lfcj: 5{c:, ^mmmm<ommm 

[0 13 5] 1^, *IIJfe?^^T-tt, S 1 8 ORXJ^S 1 9 
Ocoiil}-miK Atl^^MIizm^L^ SI 40, S15 

L> S 2 2 0~S 2 7 OCDiJiaTSS, lS^#SM9(w|BS 
S 2 8 0 (D4fiaA5, ^S^lJ^»^SM 1 1 (C+B^ LT 

v^So ^ LT. . s 2 1 0 <Dmmi>^. w^m^^mu i 3 

{dta^ S 1 1 O&Xf S 1 2 0C0«!;a;6S, KISU^SM 
1 Qfcti^L, s 1 sorotoa*^ ^M^SMl Zdffi 

[0 13 6] *fc. :^mmmW<X^n. >Pf3Sx-i?IEti$l5 
3 5 JJS. i6f^l*g^^ffl7^-i5'|5ft^^M 7 {Cffi^ L, 
^-1f-7'n7r'f^HB«^3 7^5. eX1f^I5«#ISM 
1 5{cffi^LTV''5„ ^LT, lil4~EI8{C'^J^Lfc*f 
fg'f'— ^(^5*3t?. 7'1'^'L9~L11 , L15 , L21 CO^fg 

L12 ~L14 , L20 , L22 , L23 ©*fig-r — ^ ^ 2 
*lf^l^^K:^fflx-^D2{;i1f^L. ^-rVLie ~L18 
W^ffgr'— ^r^S, m3 0iijf^F*3^^^ffi7^-^D3(;itg 

^b. ^-rvLiQ <D*MS7^-^'*s, ^4ro»)f^rt^s::fe 

.10 13 71 ft&^^A^^^0•!l^wO^^Ttft§^•r5o * - 
-f. *lllfeJ^filro«»gie 1 -C-Ht, VI csit«-^, n 

it). ^^cr)^:t^ia?:ffigUTV>^ (S 2 0 0) „ i^. 
[0 13 8] J:oT. mx.\fJimmixnm^iai. 

itroBI^-^Eg^XU!I^W?8?&ffiaLTVNSfc» (S 1 4 

0) . ^Jx.«, ^®*5$«:oS-^[c(i, rM,Hj<^iSa:ilH4' 



[0 13 9] SfJ^»i^ei;dSffilii-5mF*il*^51<D5 
i/^S;<)^tt/^^P^/iP»g?Sll, TIB© □ (^K)J;5{-IBi6 

[SEAT.ID , PSTYPE, PATYPE, PTYPE , PROFILE_ID] 
(Si. SEAT.ID tt. J^^ ('>— h) <^5^IS5r«-rx-i?t? 

SEAT_ID =0;4Siieffi^^L. SEAT.ID =l:dSib#* 
^*L. SEAT_ID =2iS^^ffi^:&§r^7^L. SEAT_ID =3*5 
^gBffi^q^:^5r*L. SEAT.ID =4*s#^M^&^,^-ro 

[0 14 0] PSTYPEtt. *Mro't4SiJ*«i-r— ^ 

T-fc <? . PSTYPE=0*5^ifei^lji!^/<c ir'cD APs^Jlil^^^.T^ L. 
PSTYPE=l7)S:g't4^r^L. PSTYPE=2}i5:^tt^^-rc 
IC. PATYPEfi. ^».(D^m(D^m^^-r7'—$'Xh^ . 
PATYPE=0;dSfL!lSr^L. PATYPE=lAS^*ieSr* L. PATYPE 
=2*S/jN^^Sr;^L. PATYPE=3>4S^i^^S:;^L. PATYPE=4 
^SffiCJ^^r^^L., PATYPE=5;dS^#^^L. PATYPE=6;JS— 
jRA?r*L. PATYPE=7;dS*A^:^i-, 

[0 14 1] ^LT> PTYPE tt. «*(D^'^'>^S:^-r5=^ 
-^'T-fc9. PTYPE =0*S51te^ (K^-r^^) &^L. PT 
YPE =lz5SSfe#roiHfll#Sr;^L, PTYPE =2dSSte*<^^ 
«SrS%L.. PTYPE =ZtiWBm<om^7^\.. PTYPE =4dSa 
^#Wftfe0^^5r^L. PTYPE =5dS^SlJJi^(OiSbV''A 
$r;T^L. PTYPE =6;4Sate^<O*0 ASr;^^ PTYPE =7dS^ 
coftfecDASr^-To 

[0 14 2] -eLTMfc:, PROFILE.ID«. *M<^ftiS* 
V^(i^miS:«1-f^-i?T-fc5o i-oT. [SEAT 
_ID , PSTYPE, PATYPE, PTYPE , PROFILE.ID] = [2, 1 

,2,2, oo;*:gi5] co^-g-fcitt. ^^um.my^\zm^ 

[0143] ^ LT. r <^J: 9 ti'l^U^Wmmm. 1 *5ffi 
tt^iiO. ^!l;t{iTIE(0 (1) ~ (3) (D^o 

JJ^T-t^S, 

(1) ^m^^ff!ikmi)^h^Mi.fz.mz. rf^^LSL 

yiXT^\>\ J irV^oTtSs^tOJi— v^i^^h^lS&fT 
[0144] ( 2 ) *:M;&sf?*t^lig*-e)|gjt-r ^.^{c. 

( 3 ) ";fcg|5'' , "7- u fSfS" i: I > 5 2 O05 

^-!7-KSrBIgLfcR!F»c:. r*:g|5^{::7^ w-f «fS©* 
igl-^i^fSftT-t-*^ j tv^ofcRg 
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[0 1 4 5] Sfc. ■esjx.fi. [SEAT_ID , PSTYPE, PATY 
"'PE, PTYPE , PROFILE_ID] = [2,2,6, 1 , 00?E 
' ^] , [SEAT_ID ,. PSTYPE, PATYPE, PTYPE , PROFILE. 

ID] = [2 , 2 , 0 , 2 , 00^^/60 (om-^ia^. m 
[0 14 7] -:)j^tz. mm-^mii>-^m-r?)Mf^^N. 

-rs 1 2 t'-y h(Dy^--i$' (t^T. AUDIO_ENV irfSi-) 

io-ciBsfi-rs:: t/Os-c-^So IP*>, audio_env o*t 
fitf 3/ h^O fc's/ h S i: Lfc^-g-. «?!l;ttf. 0 ify h S 

—V(0-^>'/:ty^^\^, 2 t's/ h gflMDy^u— -V<r3 
;rv/;*-7S:^L, 3 t'-^ h g«D VD(D3^->'/;d-7$- 
L, 9 fcf h Sli«K«:^>'/:*-7Sr^L, 1 0 tfy h 

10 14 8] J;oT. AUDIO_ENV = [lOOO 000 

1 0100] (om^\z.\!i, ^-fey h txUf tmiSi:*^:*-^' 
(c/£oTU^Sr i:*«-f. iSSs rrofiBJ-Ctt, [] i^cDS 

lEwj; 5 7^3^— v^i.v h^lSt -^riifc^fJ^-rsKlf^t «r 
[0 14 9] i-f. -hlEcOj; 9 htT^Ut'tfl; 

-fes/ hirf^i/fc') (^^ft5rT(f?)„ (SJ, cnjcj;?). AU 
DIO_ENV = [1000 0011 0100] tf£?)^ 

[0 15 0] ^ LT, :ztitmmiz^ wmn^-y k^-y 



[0151] ±fEllJ6Ji^liw*Ji9Sgg 1 {i, ^ 

mizmm^ti?>h(DX'h^tzi)^. ^f^izmx. 
H\t-f<o^mmm^Mm^i>^mzMi.xh. mmzmm 

[laffirolS^TS^I^l 

[IS 1 1 ^^m(Dmmmm<om^im^-tiyti y ^ 
X'h^o 

[S3] mmmm<Dmm-&m.x-mn-^t\.h^m^m-r. 

[04] *J-S§x— >^co— ^iJSrlftig-r'SBlrop*, 
[05] jy-fg-r— ^5''<-;^cD— ««l5:^BJ-r.50<75p*> 

■?r03T'fc5o 

[0 7] mif~d'-<—7.(D—m^mM-t^m(Do-^ 

[0 8] *)-fS7='— «^SrIft?g-r5H05 5*> 
[?^-§-©lft?^] 

l-©m^fi 3-A:^Sge 5-W^n7;i-V 
7"-;^f— 

g.-.^t-y— >3>'^g ii...*^^e 13... 

2 l-'>y^7-M.Vm^ 2 S—Y^'^^i— ^ ( I / 
F) 

2 5 2 7 -^^P-^^U 

3 l - -< l^^—^y VT VU:^7'~-'^^—y^ 33... 

3 S-f^m'f-'^W&n L1~L23 -^MSt"— ^ 
3 7--3.-ifyn7r-r/HBtt^ 

Mi" A;'3^S M3-««| M5" ;tfeSe^ai^lfe 

D2- ■•^2Wiiif^|^^^^ffi7^-^' D3-M3 05tft 
D4--®4roi!pf^rt3S^Sffl'7'-^' M9"K^^|£ 

M 1 1 -asftijw^i^ M 1 3 ■■■m^m-&^m 

Ml 5 HaAm«IE1t#l£ M17 "^M^S M 
1 9-iaS'J¥lfe 
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